-- Logs begin at Mon 2022-08-22 16:42:53 UTC, end at Mon 2022-08-22 18:06:30 UTC. -- Aug 22 17:38:14.543253 dv-osbrick-853787-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 17:38:14.552442 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 17:38:14 2022] *** Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: nodename: dv-osbrick-853787-1-ceph Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: machine: x86_64 Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: clock source: unix Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: pcre jit disabled Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: detected number of CPU cores: 4 Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: current working directory: / Aug 22 17:38:14.554400 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: detected binary path: /usr/bin/uwsgi-core Aug 22 17:38:14.554940 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: your processes number limit is 47680 Aug 22 17:38:14.554940 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: your memory page size is 4096 bytes Aug 22 17:38:14.554940 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: detected max file descriptor number: 2048 Aug 22 17:38:14.554940 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: lock engine: pthread robust mutexes Aug 22 17:38:14.554940 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: thunder lock: enabled Aug 22 17:38:14.554940 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 17:38:14.554940 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 17:38:14.599092 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: Python main interpreter initialized at 0x55d20532f9c0 Aug 22 17:38:14.599092 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: python threads support enabled Aug 22 17:38:14.599092 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: your server socket listen backlog is limited to 100 connections Aug 22 17:38:14.599092 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: your mercy for graceful operations on workers is 90 seconds Aug 22 17:38:14.599460 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 17:38:14.599460 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: *** Operational MODE: preforking *** Aug 22 17:38:14.599758 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: *** uWSGI is running in multiple interpreter mode *** Aug 22 17:38:14.599758 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: spawned uWSGI master process (pid: 100223) Aug 22 17:38:14.599974 dv-osbrick-853787-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 22 17:38:14.601386 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: spawned uWSGI worker 1 (pid: 100233, cores: 1) Aug 22 17:38:14.601386 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: spawned uWSGI worker 2 (pid: 100234, cores: 1) Aug 22 17:38:14.601386 dv-osbrick-853787-1-ceph devstack@keystone.service[100223]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 17:38:19.153472 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:38:19.153472 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: from cryptography.utils import int_from_bytes Aug 22 17:38:19.154310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:38:19.154310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: from cryptography.utils import int_from_bytes Aug 22 17:38:19.154310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:38:19.154310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: from cryptography.utils import int_from_bytes Aug 22 17:38:19.154828 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:38:19.154828 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: from cryptography.utils import int_from_bytes Aug 22 17:38:19.202984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:38:19.203185 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:38:19.203339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] command line args: [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:38:19.203600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:38:19.203735 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:38:19.203821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ================================================================================ {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:38:19.203956 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:38:19.204093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] admin_token = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.204180 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] command line args: [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:38:19.204271 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] config_dir = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.204418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.204510 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:38:19.204585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ================================================================================ {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:38:19.204745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] config_source = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.204829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] admin_token = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.204896 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] debug = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205050 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] config_dir = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205427 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] config_source = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] debug = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] insecure_debug = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205778 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.205991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] insecure_debug = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206246 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] list_limit = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206567 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] log_config_append = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206567 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206688 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] log_dir = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206874 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] list_limit = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.206956 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] log_file = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207027 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] log_config_append = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207132 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207357 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] log_dir = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207553 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] log_file = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207707 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207789 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.207980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208715 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.208895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209035 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209130 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209210 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.209972 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] notification_format = cadf {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210187 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210267 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210443 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] notification_format = cadf {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210767 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] publish_errors = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.210951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211279 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211425 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211594 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] publish_errors = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.211939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212051 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] standard_threads = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212235 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212304 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] strict_password_check = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212455 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212570 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] use_eventlog = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212772 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] use_journal = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.212959 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] standard_threads = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] use_json = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] strict_password_check = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213260 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] use_stderr = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] use_syslog = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213396 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213535 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] use_eventlog = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213615 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] watch_log_file = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] use_journal = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.213887 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] use_json = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.213994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.214081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] use_stderr = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.214211 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] use_syslog = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.214314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.214463 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] watch_log_file = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:38:19.214544 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.214688 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.214779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.214910 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.214987 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215169 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215641 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.215951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216121 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216355 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216436 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216594 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216688 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216855 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.216946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.217096 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.217173 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.217326 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.217402 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.217556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.217640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.217805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.218712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.218843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.218967 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.219090 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.219247 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.219328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.219525 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.219641 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.219794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.219959 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220037 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220312 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220567 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.220976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221054 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221202 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221284 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221757 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221922 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.221997 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222147 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222372 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222449 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222690 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222857 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.222940 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223179 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223475 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223578 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223868 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.223951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224027 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224149 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224377 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224632 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.224858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225017 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225162 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225312 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225389 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225641 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.225859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226018 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226092 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226242 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226471 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226701 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.226931 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227014 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227164 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227241 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227470 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227623 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227855 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.227929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228157 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228314 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228401 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228642 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228792 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.228878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229025 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229253 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229332 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229803 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.229954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230032 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230179 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230495 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230725 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.230950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231109 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231187 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231345 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231661 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.231895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232126 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232518 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232593 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.enabled = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.232853 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.enabled = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233775 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.233928 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234003 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234157 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234234 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234386 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234468 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234618 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234852 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.234929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235114 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235201 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235693 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235846 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.235914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236116 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236261 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236480 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236729 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236809 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.236954 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237041 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237182 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237259 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237631 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237715 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237860 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.237936 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238409 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238808 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.238884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239041 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239124 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239294 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] auth.external = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239551 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] auth.mapped = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.239880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240027 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] auth.external = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] auth.mapped = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] auth.password = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240516 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] auth.token = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240593 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240776 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.240867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] catalog.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241087 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] auth.password = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] auth.token = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] catalog.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.241937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242393 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] credential.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242470 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242634 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] credential.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242711 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242861 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.242945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243097 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] credential.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243404 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] credential.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243564 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243643 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243795 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.243872 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.244035 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.244173 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.244263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.244427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.244505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.244756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.244849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245008 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245246 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245498 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245767 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.245851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246007 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246085 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246260 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246337 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246801 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.246961 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247422 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247499 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247743 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.247975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248217 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248444 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248630 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248720 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248869 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.248953 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249343 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249432 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249661 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249822 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.249899 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250051 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250202 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250852 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.250947 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251023 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251093 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251247 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251569 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251787 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.251939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252406 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252482 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252662 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.252985 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253391 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253467 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253641 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253879 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.253955 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254337 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254568 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.254891 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255050 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255292 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255378 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255501 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255578 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255739 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.255977 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256227 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256728 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.256973 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257203 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257748 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257893 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.257970 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.password = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.password = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258662 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258816 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.258891 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259046 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259277 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259510 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259810 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.259961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260039 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260503 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.260919 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261032 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261166 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261402 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.261945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262109 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262357 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262596 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262685 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262841 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.262916 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263164 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263399 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263554 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263628 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263779 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.263999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.264071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.264235 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.264311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.264645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.264722 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.264722 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.264826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265076 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265482 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265709 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.265888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266243 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266528 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266596 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266596 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266713 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.266841 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267030 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267151 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267626 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267754 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.267969 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] policy.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] policy.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268420 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268529 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268701 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.268904 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] receipt.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269099 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] receipt.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269359 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269466 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269569 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269659 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269820 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.269929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270512 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270512 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270633 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270633 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270746 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270805 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.270867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271236 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271387 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271445 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271568 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.271986 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] revoke.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] revoke.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] role.cache_time = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272583 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] role.cache_time = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] role.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272807 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] role.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.272907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] role.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273058 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] role.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] role.list_limit = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273419 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] role.list_limit = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273502 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273563 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273622 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273745 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.273995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274274 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274618 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274686 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.274964 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275085 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275166 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275538 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275693 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275781 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275855 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.275916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.276129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.276250 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.276327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.276547 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.276782 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.276873 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277017 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277264 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277582 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.277978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278060 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278200 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.278983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279357 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279662 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.279950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280075 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280307 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280648 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280789 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.cache_time = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.280880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281018 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.cache_time = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281481 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281565 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.provider = fernet {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281714 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.281791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.provider = fernet {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282026 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282246 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282554 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282802 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282886 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.282958 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283028 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283180 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283249 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] trust.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283401 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] trust.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283816 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.283895 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284059 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284296 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284372 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.284902 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285033 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285111 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285277 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285356 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.connection = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285549 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285634 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.285871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.connection = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286364 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286675 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.286992 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287234 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287626 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287703 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.287937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288400 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288553 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.288887 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289421 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289498 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.289878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:38:19.289963 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.290125 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:38:19.290298 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=100234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:38:19.318842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.319018 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.319123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.319202 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.319274 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.319454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.327847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.328068 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.355844 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.356104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.356987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.357197 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.407202 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.407665 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.455351 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.455666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.456204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.456448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.520750 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.520931 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521002 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521063 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521165 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521538 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521667 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.521951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.545329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.545619 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.545812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.545986 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.546217 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.546408 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.546637 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.546868 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.547292 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.547723 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.548104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.548479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.548857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.549240 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.557721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.559832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.570951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.571218 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.571315 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.571407 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.571581 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.571648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.572022 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.572084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.572262 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.572401 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.572483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.572580 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.573184 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.573184 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=100234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 17:38:19.589872 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.590101 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 17:38:19.590197 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.590337 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 17:38:19.590415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.590603 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 17:38:19.590755 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.590841 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 17:38:19.590915 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.591126 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.591248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.591398 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.591480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.591628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.591751 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.591887 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.601299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.601450 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.601639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.601732 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.601929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.602207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.602566 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.602851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.609062 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.610445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.612003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.612281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.612556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.612863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.613145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.613404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.613527 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.613628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.613706 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.613924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614169 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614274 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614587 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.614994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.615269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.615541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.615812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.616082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.638583 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.638707 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.640031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.640157 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.640285 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.640368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.644871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.644996 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.645133 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.645213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.645415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.645559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.651939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.652220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.653396 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.653677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.656235 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.656525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.656830 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.657134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.657673 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.657791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.657943 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.658033 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.658259 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.658383 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.658518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.658611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.658816 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.659104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.659371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.659641 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.674029 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.674305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.675235 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.675519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.678263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.679338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.681452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.681741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.682453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.682747 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.686027 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.687070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.689189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.690284 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.692312 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.692639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.692914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.693193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.693315 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.693453 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.693645 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.693801 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.693888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.694198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.694486 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.694780 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.709733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.710015 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.710288 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.710548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.710825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.711116 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.711384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.711644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.717190 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.718563 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.718827 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.719106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.720183 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.720456 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.721807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.722101 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.722379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.722663 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.722949 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.723222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.723499 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.723789 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.724069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.724342 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.734114 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.734392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.734671 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.734950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.735254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.735530 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.735666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.735758 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.735909 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.736192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.736472 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.736777 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.737052 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.737311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.751118 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.752839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.754006 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.755816 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.757117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.758534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.758656 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.759990 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.760196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.760346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.760537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.761699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.761980 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.762259 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.766970 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.768423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.768742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.770324 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.771363 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.771650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.771926 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.772210 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.773174 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.773467 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.773742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.774052 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.780990 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.781274 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.781550 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.782096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.782412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.782696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.788503 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=100233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.788908 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.789193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.789446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=100234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 17:38:19.789590 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.789737 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.789821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.789977 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.790102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.790255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.790380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.790530 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.790652 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.790810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.790933 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.791055 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.791148 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.791331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.791455 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.791571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.791855 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.792111 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=100233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.792585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.792897 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.793164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.793455 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.793737 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.794009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=100234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 17:38:19.825229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d20532f9c0 pid: 100233 (default app) Aug 22 17:38:19.826952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d20532f9c0 pid: 100234 (default app) Aug 22 17:38:19.828645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a7e9e-1dfd-43d1-bfd5-8fcdd7a37537 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:19.829000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a7e9e-1dfd-43d1-bfd5-8fcdd7a37537 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:19.829271 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a7e9e-1dfd-43d1-bfd5-8fcdd7a37537 None None] PATH_INFO: `/v3` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:19.833571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Mon Aug 22 17:38:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:27.015491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50613-dc38-4ff3-882a-bf5e89f78b98 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:27.016302 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50613-dc38-4ff3-882a-bf5e89f78b98 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:27.016302 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50613-dc38-4ff3-882a-bf5e89f78b98 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:27.020874 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:27.026411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:27.026820 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:27.026928 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:27.103485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: INFO dbcounter [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] Registered counter for database keystone Aug 22 17:38:27.126474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG oslo_db.sqlalchemy.engines [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:38:27.138636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writer thread running {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:38:27.318704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG passlib.handlers.bcrypt [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=100233) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 17:38:27.319124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG passlib.handlers.bcrypt [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=100233) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 17:38:27.374723 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:27.376443 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:27.516081 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 17:38:28.053494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad50613-dc38-4ff3-882a-bf5e89f78b98 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:28.137079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: INFO dbcounter [None req-2ad50613-dc38-4ff3-882a-bf5e89f78b98 None None] Registered counter for database keystone Aug 22 17:38:28.163008 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG oslo_db.sqlalchemy.engines [None req-2ad50613-dc38-4ff3-882a-bf5e89f78b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:38:28.174764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writer thread running {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:38:28.296940 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad50613-dc38-4ff3-882a-bf5e89f78b98 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:28.302474 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b57652-4ac6-4846-9b1c-e35de177c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:28.303093 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b57652-4ac6-4846-9b1c-e35de177c5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:28.303363 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b57652-4ac6-4846-9b1c-e35de177c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:28.303684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b57652-4ac6-4846-9b1c-e35de177c5d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:28.312835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b57652-4ac6-4846-9b1c-e35de177c5d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:28.364656 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36b57652-4ac6-4846-9b1c-e35de177c5d4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 17:38:28.364975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b57652-4ac6-4846-9b1c-e35de177c5d4 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:28.375652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Mon Aug 22 17:38:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:38:28.382040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:28.399206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534df5d-b616-4ac0-853a-2a8380e96e93 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:28.404840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd20b24-5038-42d8-ac53-808f15234939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:28.405954 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd20b24-5038-42d8-ac53-808f15234939 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:28.406235 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd20b24-5038-42d8-ac53-808f15234939 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:28.406563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd20b24-5038-42d8-ac53-808f15234939 admin admin] PATH_INFO: `/v3/projects/8a065a84a79f4e27982ec8e2b3054801` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:28.408117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd20b24-5038-42d8-ac53-808f15234939 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a065a84a79f4e27982ec8e2b3054801)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:28.462211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ffd20b24-5038-42d8-ac53-808f15234939 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 17:38:28.462520 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd20b24-5038-42d8-ac53-808f15234939 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:28.467200 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Mon Aug 22 17:38:28 2022] GET /identity/v3/projects/8a065a84a79f4e27982ec8e2b3054801 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:30.612246 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629674-ac99-4717-93d7-ae5c6abf7442 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:30.613215 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629674-ac99-4717-93d7-ae5c6abf7442 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:30.613215 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629674-ac99-4717-93d7-ae5c6abf7442 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:30.619974 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:30.626837 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccad66-7c99-4730-b797-a8c968fd182a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:30.627281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccad66-7c99-4730-b797-a8c968fd182a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:30.627379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccad66-7c99-4730-b797-a8c968fd182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:30.653623 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-2bccad66-7c99-4730-b797-a8c968fd182a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:30.655142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-2bccad66-7c99-4730-b797-a8c968fd182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:30.665174 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 17:38:30.998328 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629674-ac99-4717-93d7-ae5c6abf7442 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:31.018918 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629674-ac99-4717-93d7-ae5c6abf7442 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:31.024436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25948020-ccbd-4a3f-9831-73b0c6755cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:31.026512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948020-ccbd-4a3f-9831-73b0c6755cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:31.026512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948020-ccbd-4a3f-9831-73b0c6755cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:31.026512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948020-ccbd-4a3f-9831-73b0c6755cc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:31.036665 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25948020-ccbd-4a3f-9831-73b0c6755cc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:31.038455 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25948020-ccbd-4a3f-9831-73b0c6755cc6 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:31.048335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Mon Aug 22 17:38:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:38:31.054528 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccad66-7c99-4730-b797-a8c968fd182a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:31.064944 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccad66-7c99-4730-b797-a8c968fd182a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:31.071625 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993356-b9ea-4a00-8197-b38e91ca48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:31.072250 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993356-b9ea-4a00-8197-b38e91ca48e0 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:31.072522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993356-b9ea-4a00-8197-b38e91ca48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:31.072817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993356-b9ea-4a00-8197-b38e91ca48e0 admin admin] PATH_INFO: `/v3/users/b314b21b589848739470473da31c8430` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:31.074344 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993356-b9ea-4a00-8197-b38e91ca48e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b314b21b589848739470473da31c8430)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:31.076177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993356-b9ea-4a00-8197-b38e91ca48e0 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:31.077727 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Mon Aug 22 17:38:31 2022] GET /identity/v3/users/b314b21b589848739470473da31c8430 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:33.291079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732db13-c80b-42d9-afc7-fc98c7fd59c2 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:33.291585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732db13-c80b-42d9-afc7-fc98c7fd59c2 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:33.291585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732db13-c80b-42d9-afc7-fc98c7fd59c2 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:33.292965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:33.298210 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a130-55e2-4ffe-9075-3fc5e3ca5f7a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:33.298629 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a130-55e2-4ffe-9075-3fc5e3ca5f7a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:33.298748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a130-55e2-4ffe-9075-3fc5e3ca5f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:33.317264 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-1489a130-55e2-4ffe-9075-3fc5e3ca5f7a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:33.318448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-1489a130-55e2-4ffe-9075-3fc5e3ca5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:33.361872 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbb88-a90f-4eda-a4b3-6754a78205e3 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:33.362155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbb88-a90f-4eda-a4b3-6754a78205e3 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:33.362423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbb88-a90f-4eda-a4b3-6754a78205e3 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:33.364004 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:33.369070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:33.369350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:33.369624 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:33.413969 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG passlib.handlers.bcrypt [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=100234) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 17:38:33.414407 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG passlib.handlers.bcrypt [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=100234) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 17:38:33.460181 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:33.461876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:33.515927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:33.561933 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:33.831624 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a130-55e2-4ffe-9075-3fc5e3ca5f7a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:33.856258 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:33.887287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:33.937385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a130-55e2-4ffe-9075-3fc5e3ca5f7a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:33.972424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:33.973082 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:33.973364 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:33.973641 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:33.987645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:33.996376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:33.997468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:33.998519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:34.003895 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:34.012238 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57e647-7388-4c71-a9cc-dc61786c9b8e None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:34.014666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:34.050475 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:34.051339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:34.051624 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:34.051897 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:34.087031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:34.105974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b0171-6d82-4f30-8f06-ed3fb9de4a68 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:34.120884 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:34.122499 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:34.146403 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:34.147027 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:34.147306 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:34.147575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:34.148265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:34.148560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:34.150030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:34.163231 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:34.169018 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:34.225401 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 17:38:34.231173 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:34.233864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:34.280296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2dccf-1ded-4d14-9125-d670af7071ca None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:34.317147 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:34.317787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:34.318023 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:34.318291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] PATH_INFO: `/v3/users/b314b21b589848739470473da31c8430` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:34.319423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] RBAC: Authorizing `identity:get_user(user_id=b314b21b589848739470473da31c8430)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:34.321225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:34.323032 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:34 2022] GET /identity/v3/users/b314b21b589848739470473da31c8430 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:34.328736 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:34.333472 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9ce4-35ec-4e2f-a81f-8cae527cb958 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:34.343047 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:34.367680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:34.368535 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:34.368837 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:34.369103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:34.387338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:34.388900 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:38:34.408376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:34.409428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:38:34.410230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:38:34.410230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:38:34.410230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:38:34.410230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:38:34.415654 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:34.431188 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b91a5-6cdf-4ef1-b2cf-69de4ff9b8de None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:34.466538 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:34.467198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:34.467505 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:34.467807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:34.469187 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:34.470637 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:34.472209 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:34.474787 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:34.478020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:34.565267 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:34.601108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccadbcd-7bb7-4fc1-a1ad-4f2b9a636121 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:34.632009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57ef99-654a-4950-8e8f-418a6de279de None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:34.637139 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d6e5a-7514-4f3b-8255-dd6466668f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:34.637748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6e5a-7514-4f3b-8255-dd6466668f77 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:34.638021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6e5a-7514-4f3b-8255-dd6466668f77 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:34.638285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6e5a-7514-4f3b-8255-dd6466668f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:34.638991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d6e5a-7514-4f3b-8255-dd6466668f77 None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.domain.id=default, user.id=b314b21b589848739470473da31c8430) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:34.639346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d6e5a-7514-4f3b-8255-dd6466668f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:34.640900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d6e5a-7514-4f3b-8255-dd6466668f77 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:34.647745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1322 bytes} [Mon Aug 22 17:38:34 2022] GET /identity/v3/role_assignments?user.id=b314b21b589848739470473da31c8430&scope.domain.id=default&role.id=1122faa21ccf460d936f2efb595661ff => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:34.668894 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a49023-bdb0-4d1e-9c94-b54a7c16f032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:34.669537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a49023-bdb0-4d1e-9c94-b54a7c16f032 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:34.669819 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a49023-bdb0-4d1e-9c94-b54a7c16f032 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:34.670089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a49023-bdb0-4d1e-9c94-b54a7c16f032 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:34.670750 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a49023-bdb0-4d1e-9c94-b54a7c16f032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:34.671122 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a49023-bdb0-4d1e-9c94-b54a7c16f032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:34.672576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a49023-bdb0-4d1e-9c94-b54a7c16f032 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:34.693188 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:37.118744 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8680f9-48c7-4ae0-a981-1c32df22655d None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:37.119590 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8680f9-48c7-4ae0-a981-1c32df22655d None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:37.119996 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8680f9-48c7-4ae0-a981-1c32df22655d None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:37.121522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:37.127654 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e5cf1-5d56-457e-b9c5-72263a03dff5 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:37.128124 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e5cf1-5d56-457e-b9c5-72263a03dff5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:37.128208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e5cf1-5d56-457e-b9c5-72263a03dff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:37.158724 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-722e5cf1-5d56-457e-b9c5-72263a03dff5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:37.160687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-722e5cf1-5d56-457e-b9c5-72263a03dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:37.255072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:37.581723 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec67a-83b5-47ca-ae14-213ad770c08a None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:37.582116 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec67a-83b5-47ca-ae14-213ad770c08a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:37.582481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec67a-83b5-47ca-ae14-213ad770c08a None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:37.584232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:37.594530 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f852-9dd4-401c-8541-2a47edb3fd7d None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:37.594910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f852-9dd4-401c-8541-2a47edb3fd7d None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:37.595051 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f852-9dd4-401c-8541-2a47edb3fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:37.617194 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-23f5f852-9dd4-401c-8541-2a47edb3fd7d None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:37.618445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-23f5f852-9dd4-401c-8541-2a47edb3fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:37.674005 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:37.706673 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 12/25] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:37.967490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cf90-8512-4e03-8abb-62733e9d194f None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:37.967824 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cf90-8512-4e03-8abb-62733e9d194f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:37.967992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cf90-8512-4e03-8abb-62733e9d194f None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:37.969878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 14/26] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:37.974937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1effb4-75a1-4fa1-88ce-63b99b90cd68 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:37.975229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1effb4-75a1-4fa1-88ce-63b99b90cd68 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:37.975501 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1effb4-75a1-4fa1-88ce-63b99b90cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:37.995830 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-7e1effb4-75a1-4fa1-88ce-63b99b90cd68 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:37.997078 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-7e1effb4-75a1-4fa1-88ce-63b99b90cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:38.034040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cf90-8512-4e03-8abb-62733e9d194f None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:38.099270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 13/27] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:38.147606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1effb4-75a1-4fa1-88ce-63b99b90cd68 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:38.214667 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cf90-8512-4e03-8abb-62733e9d194f None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:38.288775 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b8d23-615d-42b4-a09b-92a7778bf28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:38.289463 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8d23-615d-42b4-a09b-92a7778bf28d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.289699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8d23-615d-42b4-a09b-92a7778bf28d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.290020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8d23-615d-42b4-a09b-92a7778bf28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.317189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8d23-615d-42b4-a09b-92a7778bf28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:38.318719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8d23-615d-42b4-a09b-92a7778bf28d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:38.322138 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-288b8d23-615d-42b4-a09b-92a7778bf28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:38:38.344399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:38.345361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:38:38.346142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:38:38.346142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:38:38.346142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:38.346142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 15/28] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:38.352712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66f3d6-5fe6-4b05-bfec-4afe2b569596 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.353939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66f3d6-5fe6-4b05-bfec-4afe2b569596 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.354415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66f3d6-5fe6-4b05-bfec-4afe2b569596 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.356878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 16/29] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:38.357518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66f3d6-5fe6-4b05-bfec-4afe2b569596 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:38.394845 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1effb4-75a1-4fa1-88ce-63b99b90cd68 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:38.413393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:38.470771 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b65c2-00e7-4326-bd60-b4fe3dc3fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:38.472626 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b65c2-00e7-4326-bd60-b4fe3dc3fdb5 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.472920 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b65c2-00e7-4326-bd60-b4fe3dc3fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.473195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b65c2-00e7-4326-bd60-b4fe3dc3fdb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.492786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b65c2-00e7-4326-bd60-b4fe3dc3fdb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-828b65c2-00e7-4326-bd60-b4fe3dc3fdb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:38.501461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:38.502336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:38:38.503079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 14/30] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:38:38.508683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d533-9bf4-4588-9a95-66a0b3cd70cf None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.508683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d533-9bf4-4588-9a95-66a0b3cd70cf None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.508683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d533-9bf4-4588-9a95-66a0b3cd70cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.528797 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66f3d6-5fe6-4b05-bfec-4afe2b569596 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:38.532164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-3977d533-9bf4-4588-9a95-66a0b3cd70cf None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:38.533418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-3977d533-9bf4-4588-9a95-66a0b3cd70cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:38.569724 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:38.570410 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.571048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.571320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.572174 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:38.572528 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:38.574259 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:38.595175 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 17/31] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:38.596067 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:38.609227 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 15/32] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:38.610289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d533-9bf4-4588-9a95-66a0b3cd70cf None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:38.668292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:38.717719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b54c27-ec36-45e4-bb63-556177d8f7c3 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:38.747153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:38.753232 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d533-9bf4-4588-9a95-66a0b3cd70cf None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:38.758400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de367442-77b9-4d83-9e9b-7902b2a09893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:38.759216 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de367442-77b9-4d83-9e9b-7902b2a09893 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.759657 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de367442-77b9-4d83-9e9b-7902b2a09893 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.760065 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de367442-77b9-4d83-9e9b-7902b2a09893 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.760900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de367442-77b9-4d83-9e9b-7902b2a09893 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:38.762524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de367442-77b9-4d83-9e9b-7902b2a09893 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:38.792697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:38.793300 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.793580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.793851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.794521 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:38.794821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:38.796240 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:38.809415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 16/33] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:38.810237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:38.906514 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 18/34] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Aug 22 17:38:38 2022] POST /identity/v3/roles => generated 225 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:38.912883 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd742f-29b6-418f-92a8-bb5c03377d80 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:38.913495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377958-58b8-49c6-bb2a-62ca4a1fdae6 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.913921 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377958-58b8-49c6-bb2a-62ca4a1fdae6 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.914326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377958-58b8-49c6-bb2a-62ca4a1fdae6 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.916040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 19/35] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:38.916901 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09377958-58b8-49c6-bb2a-62ca4a1fdae6 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:38.950784 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:38.951473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:38.951980 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:38.952347 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:38.953828 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:38.955546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:39.059673 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09377958-58b8-49c6-bb2a-62ca4a1fdae6 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:39.079925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:39.106129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5238cd-4c46-4c40-8fda-70654df7d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:39.107038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5238cd-4c46-4c40-8fda-70654df7d523 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.107480 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5238cd-4c46-4c40-8fda-70654df7d523 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.107897 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5238cd-4c46-4c40-8fda-70654df7d523 None admin] PATH_INFO: `/v3/users/b314b21b589848739470473da31c8430` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.109623 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5238cd-4c46-4c40-8fda-70654df7d523 None admin] RBAC: Authorizing `identity:get_user(user_id=b314b21b589848739470473da31c8430)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:39.111491 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5238cd-4c46-4c40-8fda-70654df7d523 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:39.113772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 20/36] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:38 2022] GET /identity/v3/users/b314b21b589848739470473da31c8430 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:39.115266 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57598c76-90c0-4d2c-9ee2-840db4a2ad76 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.115726 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57598c76-90c0-4d2c-9ee2-840db4a2ad76 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.116144 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57598c76-90c0-4d2c-9ee2-840db4a2ad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.124867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 17/37] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:38:38 2022] POST /identity/v3/projects => generated 301 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:39.126260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:39.136982 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-57598c76-90c0-4d2c-9ee2-840db4a2ad76 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:39.138997 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-57598c76-90c0-4d2c-9ee2-840db4a2ad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:39.142315 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:39.231598 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 21/38] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:39.233292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57598c76-90c0-4d2c-9ee2-840db4a2ad76 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:39.265646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ebd3c-70e7-43b2-8d7f-3b3e43bb5f1d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:39.306422 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35feba9-f2f3-4ee9-9f20-b01edfeddd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:39.307011 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35feba9-f2f3-4ee9-9f20-b01edfeddd78 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.307298 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35feba9-f2f3-4ee9-9f20-b01edfeddd78 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.307582 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35feba9-f2f3-4ee9-9f20-b01edfeddd78 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.308268 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35feba9-f2f3-4ee9-9f20-b01edfeddd78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:39.310161 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35feba9-f2f3-4ee9-9f20-b01edfeddd78 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:39.332747 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 18/39] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Aug 22 17:38:39 2022] POST /identity/v3/roles => generated 219 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:39.334259 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d756b-9820-4f37-b925-cc7a29d24626 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.334600 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d756b-9820-4f37-b925-cc7a29d24626 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.334893 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d756b-9820-4f37-b925-cc7a29d24626 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.336678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 19/40] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:39.342823 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a96b-50ea-4dc9-98e9-2996e8324518 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.343177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a96b-50ea-4dc9-98e9-2996e8324518 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.343596 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a96b-50ea-4dc9-98e9-2996e8324518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.365477 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-0380a96b-50ea-4dc9-98e9-2996e8324518 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:39.367334 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-0380a96b-50ea-4dc9-98e9-2996e8324518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:39.387963 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57598c76-90c0-4d2c-9ee2-840db4a2ad76 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:39.407169 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:39.443167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:39.444214 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.444544 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.444866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.446866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:39.449289 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:39.451887 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 22/41] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:39.458100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:39.460718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:39.470669 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 20/42] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:39.577204 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c43bd-5ebd-4d9c-b021-38c408442cbf None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:39.615351 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:39.616387 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.616888 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.617407 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] PATH_INFO: `/v3/domains/default/users/b314b21b589848739470473da31c8430/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.619602 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b314b21b589848739470473da31c8430, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:39.621254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:39.638023 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 23/43] 10.222.0.59 () {58 vars in 1361 bytes} [Mon Aug 22 17:38:39 2022] PUT /identity/v3/domains/default/users/b314b21b589848739470473da31c8430/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:38:39.706972 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a96b-50ea-4dc9-98e9-2996e8324518 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:39.815181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:39.824266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a96b-50ea-4dc9-98e9-2996e8324518 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:39.860480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:39.861046 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.861322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.861594 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.862266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:39.863104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:39.864011 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:39.880416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 21/44] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Aug 22 17:38:39 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:39.934328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d0292-25ae-4028-ba21-afad666478ec None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:39.972282 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea8a2-f56b-489b-abd7-d76ab3080218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:39.972974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea8a2-f56b-489b-abd7-d76ab3080218 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:39.973255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea8a2-f56b-489b-abd7-d76ab3080218 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:39.973523 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea8a2-f56b-489b-abd7-d76ab3080218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:39.974678 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea8a2-f56b-489b-abd7-d76ab3080218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:39.976157 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea8a2-f56b-489b-abd7-d76ab3080218 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:39.978037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 24/45] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:39.983590 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:40.048661 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:40.099065 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bbff5-d454-43e3-a6ac-19828b116290 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:40.134030 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd54b0-03b2-4906-86fb-ac207184f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:40.134406 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd54b0-03b2-4906-86fb-ac207184f42c None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:40.134688 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd54b0-03b2-4906-86fb-ac207184f42c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:40.134961 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd54b0-03b2-4906-86fb-ac207184f42c None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:40.135606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd54b0-03b2-4906-86fb-ac207184f42c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:40.137111 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd54b0-03b2-4906-86fb-ac207184f42c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:40.164432 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 22/46] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:38:39 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:41.803609 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b588a-60aa-4689-b2e8-6fd2730dc537 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:41.804125 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b588a-60aa-4689-b2e8-6fd2730dc537 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:41.804207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b588a-60aa-4689-b2e8-6fd2730dc537 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:41.805688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 25/47] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:41.811216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe881c-ea76-42a5-a887-ca06a851904a None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:41.811647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe881c-ea76-42a5-a887-ca06a851904a None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:41.811810 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe881c-ea76-42a5-a887-ca06a851904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:41.830410 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-4ebe881c-ea76-42a5-a887-ca06a851904a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:41.831570 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-4ebe881c-ea76-42a5-a887-ca06a851904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:41.904659 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 23/48] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:42.226980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b588a-60aa-4689-b2e8-6fd2730dc537 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:42.330862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f834fa9-51ef-4e6a-8df4-59aa475a2b86 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.331141 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f834fa9-51ef-4e6a-8df4-59aa475a2b86 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.331411 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f834fa9-51ef-4e6a-8df4-59aa475a2b86 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.332740 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 24/49] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:38:42.337391 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b588a-60aa-4689-b2e8-6fd2730dc537 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:42.337940 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca19b8-1bea-4d4b-a12e-1119a51605d1 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.338219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca19b8-1bea-4d4b-a12e-1119a51605d1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.338487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca19b8-1bea-4d4b-a12e-1119a51605d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.348932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:42.358609 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-e7ca19b8-1bea-4d4b-a12e-1119a51605d1 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:42.359837 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-e7ca19b8-1bea-4d4b-a12e-1119a51605d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:42.374677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:42.375229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.375510 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.375786 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.386805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:42.391493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:42.392423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:42.393224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 26/50] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:42.396320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:42.398680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:42.429506 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 25/51] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:42.497679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566017d7-546e-4140-b3f9-eb66eb86afb9 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:42.532771 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:42.533379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.533661 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.533929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.534590 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:42.534891 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:42.536285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:42.544801 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 27/52] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:42.550770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca19b8-1bea-4d4b-a12e-1119a51605d1 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:42.650833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca19b8-1bea-4d4b-a12e-1119a51605d1 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:42.690997 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:42.691645 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.691928 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.692202 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] PATH_INFO: `/v3/users/b314b21b589848739470473da31c8430` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.693683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] RBAC: Authorizing `identity:get_user(user_id=b314b21b589848739470473da31c8430)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:42.695447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:42.697117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:42 2022] GET /identity/v3/users/b314b21b589848739470473da31c8430 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:42.703233 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:42.735401 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:42.766894 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:42.808274 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27a72f-8ced-466f-bbff-4a1931b24bca None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:42.809608 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:42.846884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:42.847524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.847806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.848080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.849205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:42.850673 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:42.852254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 28/54] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:42.857955 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:42.872996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902636-ab89-4325-a473-df7068777bcc None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:42.907827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:42.908452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.908767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.909035 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.910155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:42.911583 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:42.913427 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:42.918722 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:42.957762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:42.960909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6941f4-2d11-4476-ba05-f6b99a6380d8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:42.995883 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08796dd-e19a-492f-aabe-ef9cc15213bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:42.996493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08796dd-e19a-492f-aabe-ef9cc15213bf None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:42.996804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08796dd-e19a-492f-aabe-ef9cc15213bf None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:42.997077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08796dd-e19a-492f-aabe-ef9cc15213bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:42.997792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08796dd-e19a-492f-aabe-ef9cc15213bf None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.domain.id=default, user.id=b314b21b589848739470473da31c8430) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:42.998095 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08796dd-e19a-492f-aabe-ef9cc15213bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:42.999742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08796dd-e19a-492f-aabe-ef9cc15213bf None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:43.005654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 29/56] 10.222.0.59 () {56 vars in 1322 bytes} [Mon Aug 22 17:38:42 2022] GET /identity/v3/role_assignments?user.id=b314b21b589848739470473da31c8430&scope.domain.id=default&role.id=1122faa21ccf460d936f2efb595661ff => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:43.018759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cf480-6e90-4790-aa87-536b9006adfd None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:43.029436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:43.058127 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b27b5f-956c-43f0-9f63-20e0a0b0b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:43.058753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b27b5f-956c-43f0-9f63-20e0a0b0b168 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:43.059036 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b27b5f-956c-43f0-9f63-20e0a0b0b168 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:43.059312 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b27b5f-956c-43f0-9f63-20e0a0b0b168 None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:43.059976 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b27b5f-956c-43f0-9f63-20e0a0b0b168 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:43.061514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b27b5f-956c-43f0-9f63-20e0a0b0b168 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:43.095835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 28/57] 10.222.0.59 () {60 vars in 1140 bytes} [Mon Aug 22 17:38:42 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:38:45.277438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094e3f5-9d06-46a3-9f2f-335d2a15ff4b None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:45.278236 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094e3f5-9d06-46a3-9f2f-335d2a15ff4b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:45.278355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094e3f5-9d06-46a3-9f2f-335d2a15ff4b None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:45.280645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 30/58] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:45.286982 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a544-374c-4bfc-a540-567cb9a719f0 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:45.287650 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a544-374c-4bfc-a540-567cb9a719f0 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:45.287750 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a544-374c-4bfc-a540-567cb9a719f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:45.314478 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-ccf5a544-374c-4bfc-a540-567cb9a719f0 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:45.315726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-ccf5a544-374c-4bfc-a540-567cb9a719f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:45.383942 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 29/59] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:45.720755 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094e3f5-9d06-46a3-9f2f-335d2a15ff4b None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:45.828774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094e3f5-9d06-46a3-9f2f-335d2a15ff4b None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:45.863448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100ac8e-ba9a-4300-8e29-de1bbc6398d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:45.864056 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ac8e-ba9a-4300-8e29-de1bbc6398d0 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:45.864338 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ac8e-ba9a-4300-8e29-de1bbc6398d0 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:45.864603 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ac8e-ba9a-4300-8e29-de1bbc6398d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:45.865783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100ac8e-ba9a-4300-8e29-de1bbc6398d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:45.867226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100ac8e-ba9a-4300-8e29-de1bbc6398d0 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:45.868799 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 31/60] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:45.875414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a544-374c-4bfc-a540-567cb9a719f0 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:45.985173 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:45.996085 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a544-374c-4bfc-a540-567cb9a719f0 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:46.038454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d88b41-9955-405b-bcd3-22e1c1e45eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:46.039405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88b41-9955-405b-bcd3-22e1c1e45eac None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:46.039878 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88b41-9955-405b-bcd3-22e1c1e45eac None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:46.040695 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88b41-9955-405b-bcd3-22e1c1e45eac None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:46.041302 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88b41-9955-405b-bcd3-22e1c1e45eac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:46.043013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88b41-9955-405b-bcd3-22e1c1e45eac None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:46.073762 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 30/61] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:38:45 2022] POST /identity/v3/users => generated 275 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:49.552910 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9f61-5bad-4ee6-a141-749a38f0fc3b None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:49.553999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9f61-5bad-4ee6-a141-749a38f0fc3b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:49.554479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9f61-5bad-4ee6-a141-749a38f0fc3b None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:49.556063 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 32/62] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:49.561824 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e008bb-852b-4d87-99ce-4725ea99db61 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:49.562670 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e008bb-852b-4d87-99ce-4725ea99db61 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:49.563133 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e008bb-852b-4d87-99ce-4725ea99db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:49.586647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-b6e008bb-852b-4d87-99ce-4725ea99db61 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:49.588194 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b6e008bb-852b-4d87-99ce-4725ea99db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:49.598202 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d008-7897-462a-8280-420b3d6c843e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:49.598815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d008-7897-462a-8280-420b3d6c843e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:49.599280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d008-7897-462a-8280-420b3d6c843e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:49.600862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 33/63] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:38:49.606704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a92b7-2f75-4e01-8d8c-4bf64700d533 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:49.607257 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a92b7-2f75-4e01-8d8c-4bf64700d533 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:49.607732 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a92b7-2f75-4e01-8d8c-4bf64700d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:49.629962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-9c7a92b7-2f75-4e01-8d8c-4bf64700d533 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:49.631475 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-9c7a92b7-2f75-4e01-8d8c-4bf64700d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:49.659651 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:49.700150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 31/64] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:49.704233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a2da3-87ec-4911-9c4e-6818cf4f608e None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:49.704233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a2da3-87ec-4911-9c4e-6818cf4f608e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:49.704233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a2da3-87ec-4911-9c4e-6818cf4f608e None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:49.704233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 32/65] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:49.708788 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2f7ec-58f4-4cb3-9206-da8b9183d5b6 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:49.709073 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2f7ec-58f4-4cb3-9206-da8b9183d5b6 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:49.709349 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2f7ec-58f4-4cb3-9206-da8b9183d5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:49.714189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 34/66] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:49.745672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-a0b2f7ec-58f4-4cb3-9206-da8b9183d5b6 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:49.746871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-a0b2f7ec-58f4-4cb3-9206-da8b9183d5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:49.819162 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 33/67] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:50.039283 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a92b7-2f75-4e01-8d8c-4bf64700d533 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.084604 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345d55-882d-4b4a-aa1c-a3016664a672 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.084926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345d55-882d-4b4a-aa1c-a3016664a672 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.085103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345d55-882d-4b4a-aa1c-a3016664a672 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.087009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 34/68] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:38:50.092357 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ae5c9-a277-47b4-b175-fcde199af7d9 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.092978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ae5c9-a277-47b4-b175-fcde199af7d9 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.093270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ae5c9-a277-47b4-b175-fcde199af7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.110752 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:50.114589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-955ae5c9-a277-47b4-b175-fcde199af7d9 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:50.115802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-955ae5c9-a277-47b4-b175-fcde199af7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:50.184541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a92b7-2f75-4e01-8d8c-4bf64700d533 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.202534 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 35/69] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:50.203110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ae5c9-a277-47b4-b175-fcde199af7d9 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.245203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.246680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.247486 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.247935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.275673 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:50.279525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:50.280718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:50.281484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:50.284017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 35/70] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:50.289219 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.325370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:50.347291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ae5c9-a277-47b4-b175-fcde199af7d9 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.386855 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.387578 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.387949 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.388225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.391075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:50.399714 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:50.404393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:50.405412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:38:50.406171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 36/71] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:50.406802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.410110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d723f8-95e6-49cd-9794-deff6ca140a5 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.453888 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84547d9d-36b8-4ac1-86a3-381b7ad1dacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.454652 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547d9d-36b8-4ac1-86a3-381b7ad1dacb None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.454932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547d9d-36b8-4ac1-86a3-381b7ad1dacb None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.455192 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547d9d-36b8-4ac1-86a3-381b7ad1dacb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.469033 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84547d9d-36b8-4ac1-86a3-381b7ad1dacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-84547d9d-36b8-4ac1-86a3-381b7ad1dacb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:50.474296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:50.475143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:50.475902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 36/72] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:50.476818 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc10ca-9920-4fb8-886f-47641b3cc028 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.477109 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc10ca-9920-4fb8-886f-47641b3cc028 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.477392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc10ca-9920-4fb8-886f-47641b3cc028 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.478544 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 37/73] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:50.483588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc10ca-9920-4fb8-886f-47641b3cc028 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.514358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fee81f-7789-469b-b746-b4dbff227900 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.550977 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.551600 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.551882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.552156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.552889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:50.553195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:50.554588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:50.563032 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 37/74] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:50.563673 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.572676 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:50.594346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc10ca-9920-4fb8-886f-47641b3cc028 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.622734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:50.626666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac5eb7-2284-48c9-abf2-67efb2337db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.627268 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac5eb7-2284-48c9-abf2-67efb2337db4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.627548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac5eb7-2284-48c9-abf2-67efb2337db4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.627812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac5eb7-2284-48c9-abf2-67efb2337db4 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.628467 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac5eb7-2284-48c9-abf2-67efb2337db4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:50.628799 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac5eb7-2284-48c9-abf2-67efb2337db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:50.630194 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac5eb7-2284-48c9-abf2-67efb2337db4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:50.638595 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 38/75] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:50.640152 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654bdf3-d20d-4d79-a23e-e95aec7ea262 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.640438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654bdf3-d20d-4d79-a23e-e95aec7ea262 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.640706 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654bdf3-d20d-4d79-a23e-e95aec7ea262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.658545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-8654bdf3-d20d-4d79-a23e-e95aec7ea262 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:50.659746 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-8654bdf3-d20d-4d79-a23e-e95aec7ea262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:50.668452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8ce1-83d6-4791-a03e-71fc1a390098 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.703453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.704053 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.704326 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.704605 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.705294 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:50.705593 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:50.706956 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:50.714983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 38/76] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:50.715764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.727945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 39/77] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:50.728812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654bdf3-d20d-4d79-a23e-e95aec7ea262 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.815150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:50.837219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247264e-64bc-4a03-93ba-7b5a5821d3c7 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.843613 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654bdf3-d20d-4d79-a23e-e95aec7ea262 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:50.857773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:50.872639 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.873346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.873579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.873856 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.882844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:50.883797 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:50.884249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:50.884534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:50.884966 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:50.889599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:50.890453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:38:50.891287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 39/78] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:50.891908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:50.907268 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:50.908907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:50.910595 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 40/79] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:50.915912 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.004840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c95946-b04a-4fa9-9135-c2bec856ff38 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.029440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb97ca-f7fa-4474-825f-9687b87a969f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.044637 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.045287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.045630 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.045910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.047068 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.048543 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.050228 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 40/80] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:51.051050 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.064716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.070292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.070936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.071212 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.071522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] PATH_INFO: `/v3/users/b314b21b589848739470473da31c8430` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.072605 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=b314b21b589848739470473da31c8430)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.074094 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.075698 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 41/81] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:50 2022] GET /identity/v3/users/b314b21b589848739470473da31c8430 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:51.076454 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.108470 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.164922 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d37ddd-0996-401a-81d5-1ffccab50d10 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.177853 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab9fbc-3963-4bf2-8ccb-c40ced6f6ce1 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.198452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.199075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.199365 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.199637 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.200298 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:51.200602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.202077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.209985 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 41/82] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:51.213429 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.213554 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.214041 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.214319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.214843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.284548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.287081 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.289154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.315844 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f05e5-a77b-4f4a-a4e0-604d9a8fb429 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.326685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.351300 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.351935 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.352219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.352489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.353635 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.355100 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.356687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 42/83] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:51.357492 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.394188 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 42/84] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:51.395040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.458863 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f341aa-1183-430b-840b-e44b3dff27f0 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.493335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.494467 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.495169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.495454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.495796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.496276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ebf96-ab4b-4920-9c0e-6b70726dc166 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.531005 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.531616 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.531892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.532156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.541078 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.564469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.565986 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.600784 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.602329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.665846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 43/85] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:51.670693 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.703450 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.707484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 43/86] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:51.708530 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.744170 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.766599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1cc38-7d08-46e6-b475-7a7a097e0a85 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.799515 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.800149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.800429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.800755 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.801891 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.803335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.809397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 44/87] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:51.809397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.811873 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35e95-9575-4255-9bac-b2f265ed9e3d None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.846809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.847414 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.847693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.847964 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.848599 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.850080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.883555 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 44/88] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:38:51 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:51.884379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.922107 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02892d-9217-4f4a-ac22-215773c4b76e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:51.964981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:51.965806 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:51.966079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:51.966353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:51.967663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:51.969204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:51.970950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 45/89] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:51.974288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:51.976405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:52.005595 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:52.029125 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fe345-540d-411a-aa13-2ad5aae20e92 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:52.071327 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:52.072224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:52.072791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:52.073368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:52.074792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:52.076405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:52.078396 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 45/90] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:52.079453 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:52.141271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36e4f6-a9a8-4bc8-b29d-3edf81dcc3cd None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:52.181009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:52.181649 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:52.181929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:52.182201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:52.183551 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:52.185115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:52.187181 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 46/91] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:51 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:52.187815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:52.227985 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b49eec-704a-4eb7-be01-6c6d1506803c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:52.259415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:52.277330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:52.277511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:52.277701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:52.277957 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:52.286815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:52.314970 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2d31-98c0-4424-8022-cd39813a8506 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:52.354084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:52.354659 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:52.354935 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:52.355220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:52.356088 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=5bba93f9467f41078298f40969593ca0) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:52.356227 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:52.357826 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:52.367786 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:52.369224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 47/92] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:38:52 2022] GET /identity/v3/role_assignments?user.id=5bba93f9467f41078298f40969593ca0&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:52.369342 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:52.370386 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:52.586338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090c1c-a8c7-4d38-9ba0-eae529ffb818 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:52.594987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 46/93] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:52.595869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:52.626773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:52.627895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:52.628174 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:52.628445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:52.629364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] RBAC: Adding query filter params (role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=5bba93f9467f41078298f40969593ca0) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:52.629674 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:52.631118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:52.638129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 48/94] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:38:52 2022] GET /identity/v3/role_assignments?user.id=5bba93f9467f41078298f40969593ca0&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:52.638973 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:52.659654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:52.663350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:52.812687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4830b-22a2-4f4e-89d3-0a22efd96954 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:52.888896 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9d42-3ce4-4e44-aeb2-2162972f8d9c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:52.921508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:52.922187 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:52.922473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:52.922754 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] PATH_INFO: `/v3/projects/deaea8465611475b98b19ab827dd1142` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:52.924018 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] RBAC: Authorizing `identity:get_project(project_id=deaea8465611475b98b19ab827dd1142)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:52.925573 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:52.927281 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 49/95] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:52 2022] GET /identity/v3/projects/deaea8465611475b98b19ab827dd1142 => generated 312 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:52.938014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:52.970375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2ce58-54e2-4452-86de-fe49785ec59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:52.971008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2ce58-54e2-4452-86de-fe49785ec59f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:52.971287 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2ce58-54e2-4452-86de-fe49785ec59f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:52.971557 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2ce58-54e2-4452-86de-fe49785ec59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:52.972295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2ce58-54e2-4452-86de-fe49785ec59f None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=b314b21b589848739470473da31c8430) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:52.972644 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2ce58-54e2-4452-86de-fe49785ec59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:52.974111 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2ce58-54e2-4452-86de-fe49785ec59f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:52.980418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 47/96] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:38:52 2022] GET /identity/v3/role_assignments?user.id=b314b21b589848739470473da31c8430&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=1122faa21ccf460d936f2efb595661ff => generated 259 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:53.086494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:53.118278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f27d20-c0d8-46ea-a948-b4d5448d3f67 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:53.158518 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d9936-3a33-4835-aed6-2b97d1b38b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:53.159063 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9936-3a33-4835-aed6-2b97d1b38b0a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:53.159343 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9936-3a33-4835-aed6-2b97d1b38b0a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:53.159616 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9936-3a33-4835-aed6-2b97d1b38b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:53.160423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d9936-3a33-4835-aed6-2b97d1b38b0a None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=deaea8465611475b98b19ab827dd1142, user.id=5bba93f9467f41078298f40969593ca0) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:53.160768 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d9936-3a33-4835-aed6-2b97d1b38b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:53.162330 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d9936-3a33-4835-aed6-2b97d1b38b0a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:53.168560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 50/97] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:38:52 2022] GET /identity/v3/role_assignments?user.id=5bba93f9467f41078298f40969593ca0&scope.project.id=deaea8465611475b98b19ab827dd1142&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:54.794391 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9d7d-ff03-4745-8587-516296ae49ec None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:54.794917 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9d7d-ff03-4745-8587-516296ae49ec None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:54.794917 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9d7d-ff03-4745-8587-516296ae49ec None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:54.796474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 48/98] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:54.802278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe9ad2-3580-4f0f-935b-c8c6fc63c773 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:54.802714 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe9ad2-3580-4f0f-935b-c8c6fc63c773 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:54.802888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe9ad2-3580-4f0f-935b-c8c6fc63c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:54.831542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-bafe9ad2-3580-4f0f-935b-c8c6fc63c773 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:54.832755 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-bafe9ad2-3580-4f0f-935b-c8c6fc63c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:54.909240 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 51/99] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:55.339083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d1ea5-4934-4e83-b937-84101897d887 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.339405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d1ea5-4934-4e83-b937-84101897d887 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.339628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d1ea5-4934-4e83-b937-84101897d887 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.341191 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 49/100] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:55.350082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b80242-b0e2-426e-a1fe-c5af1276bca4 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.350368 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b80242-b0e2-426e-a1fe-c5af1276bca4 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.350641 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b80242-b0e2-426e-a1fe-c5af1276bca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.373631 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-64b80242-b0e2-426e-a1fe-c5af1276bca4 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:55.374833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-64b80242-b0e2-426e-a1fe-c5af1276bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:55.399566 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a84e6-7c3a-46ef-be90-87e574260e80 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.399862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a84e6-7c3a-46ef-be90-87e574260e80 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.400116 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a84e6-7c3a-46ef-be90-87e574260e80 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.401460 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 50/101] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:55.407331 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a84e6-7c3a-46ef-be90-87e574260e80 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:55.479182 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 52/102] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:55.485752 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98398a96-5ed9-43d3-a027-60fe7a27dd70 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.486344 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98398a96-5ed9-43d3-a027-60fe7a27dd70 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.486765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98398a96-5ed9-43d3-a027-60fe7a27dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.497314 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:55.516489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-98398a96-5ed9-43d3-a027-60fe7a27dd70 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:55.518690 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-98398a96-5ed9-43d3-a027-60fe7a27dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:55.575682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:55.598617 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a84e6-7c3a-46ef-be90-87e574260e80 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:55.649208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 53/103] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:55.664461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08de83-f7ef-49ba-83a0-302913962a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:55.665173 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08de83-f7ef-49ba-83a0-302913962a6b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.665459 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08de83-f7ef-49ba-83a0-302913962a6b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.665732 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08de83-f7ef-49ba-83a0-302913962a6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.666840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08de83-f7ef-49ba-83a0-302913962a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:55.668323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08de83-f7ef-49ba-83a0-302913962a6b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:55.670317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 51/104] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:55.675752 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98398a96-5ed9-43d3-a027-60fe7a27dd70 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:55.706397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae44e2-b8e9-4f85-a2a6-c963e8d5c236 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.706940 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae44e2-b8e9-4f85-a2a6-c963e8d5c236 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.707458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae44e2-b8e9-4f85-a2a6-c963e8d5c236 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.709217 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 52/105] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:55.716028 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2370d-50df-42dd-93f9-3995395ff600 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.716480 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2370d-50df-42dd-93f9-3995395ff600 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.716938 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2370d-50df-42dd-93f9-3995395ff600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.742079 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-a4f2370d-50df-42dd-93f9-3995395ff600 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:55.747953 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-a4f2370d-50df-42dd-93f9-3995395ff600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:55.857889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98398a96-5ed9-43d3-a027-60fe7a27dd70 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:55.874547 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 53/106] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:55.898254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:55.903735 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:55.904360 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:55.904865 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:55.905228 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:55.906048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:55.911426 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:55.958356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 54/107] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:38:55 2022] POST /identity/v3/projects => generated 302 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:38:55.994599 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2370d-50df-42dd-93f9-3995395ff600 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.133024 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:56.156145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2370d-50df-42dd-93f9-3995395ff600 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:56.205244 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:56.206014 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.206299 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.206574 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] PATH_INFO: `/v3/roles/member` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.221711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:56.226504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:56.227347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:56.229548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 54/108] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:56.234339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.252311 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.405943 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be05d3-a7fb-4d76-a598-113fae5bbed1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:56.426198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858cef-b348-44dc-bed8-1e41b53f840c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:56.445724 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:56.446760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.447282 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.447797 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.448753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:56.449250 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:56.450885 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:56.461535 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 55/109] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:56.462757 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.475683 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:56.476763 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.477048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.477324 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.494188 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:56.500937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:56.501886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:38:56.502639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:56.506406 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 55/110] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:38:56.511148 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.522934 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:56.539198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:56.619663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ecbc3-fa59-4fa5-8b24-8bae1c70ff3c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:56.627812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0587-ca17-4721-b8bd-6513701b14a6 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:56.664979 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:56.666455 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.666937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.667418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.668837 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:56.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:56.673292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 56/111] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:56.674725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.704257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:56.705183 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.705473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.705746 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.720018 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:56.727177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:56.728047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:38:56.728834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 56/112] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:56.729471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.775107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:56.809341 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad943-1115-4e17-b8a8-c7fae66da939 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:56.856635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb369e-6a41-453d-be7e-335fc74addb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:56.858112 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb369e-6a41-453d-be7e-335fc74addb4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.858803 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb369e-6a41-453d-be7e-335fc74addb4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.859447 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb369e-6a41-453d-be7e-335fc74addb4 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.860804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb369e-6a41-453d-be7e-335fc74addb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:56.861571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb369e-6a41-453d-be7e-335fc74addb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:56.863805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb369e-6a41-453d-be7e-335fc74addb4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:56.867575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd3c60-a82c-439c-a845-ebdedf07f4eb None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:56.876488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 57/113] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:56.877054 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:56.879353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192314a-33f8-442c-aa18-68e681f42f3e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.879826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192314a-33f8-442c-aa18-68e681f42f3e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.880316 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192314a-33f8-442c-aa18-68e681f42f3e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.882325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 58/114] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:56.883326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192314a-33f8-442c-aa18-68e681f42f3e None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:56.910889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:56.911910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:56.912388 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:56.912913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:56.914252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:56.915970 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:56.917882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 57/115] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:56.918839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.004782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192314a-33f8-442c-aa18-68e681f42f3e None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.023189 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e256f-972e-4628-806d-6a804a0e85f9 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.042556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b8d62-dba8-4c6a-8d5a-3dce5d12e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.043182 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8d62-dba8-4c6a-8d5a-3dce5d12e17c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.043446 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8d62-dba8-4c6a-8d5a-3dce5d12e17c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.043709 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8d62-dba8-4c6a-8d5a-3dce5d12e17c None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.044370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b8d62-dba8-4c6a-8d5a-3dce5d12e17c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:57.044696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b8d62-dba8-4c6a-8d5a-3dce5d12e17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.046324 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b8d62-dba8-4c6a-8d5a-3dce5d12e17c None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.048559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.056053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 59/116] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:57.057118 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a255fc1-080f-4d91-bdb9-78a0ac63155b None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.057402 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a255fc1-080f-4d91-bdb9-78a0ac63155b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.057671 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a255fc1-080f-4d91-bdb9-78a0ac63155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.065372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.066146 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.066530 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.066896 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] PATH_INFO: `/v3/users/f3fd6d8121804a2188a0bf1add448daa` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.075839 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-0a255fc1-080f-4d91-bdb9-78a0ac63155b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:57.077529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-0a255fc1-080f-4d91-bdb9-78a0ac63155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:57.085311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] RBAC: Authorizing `identity:get_user(user_id=f3fd6d8121804a2188a0bf1add448daa)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.087222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.094210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 58/117] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:56 2022] GET /identity/v3/users/f3fd6d8121804a2188a0bf1add448daa => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:57.094210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.127203 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.146985 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 60/118] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:57.152648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61670-7ae9-42a3-b898-4f3b9cd52f3c None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.152648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61670-7ae9-42a3-b898-4f3b9cd52f3c None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.152648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61670-7ae9-42a3-b898-4f3b9cd52f3c None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.152648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 61/119] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:57.153947 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61670-7ae9-42a3-b898-4f3b9cd52f3c None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.212265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f1e8-64a8-4513-9449-3430354ca582 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.247965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.248763 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.249046 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.249320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/5bba93f9467f41078298f40969593ca0/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.251246 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c774aab3a3f410cbe5fda133641dc5c, user_id=5bba93f9467f41078298f40969593ca0, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.252869 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.274667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 59/120] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:38:57 2022] PUT /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/5bba93f9467f41078298f40969593ca0/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:38:57.275774 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.303006 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61670-7ae9-42a3-b898-4f3b9cd52f3c None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.335591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.346322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba89483-a50c-4f5c-a4b7-c0baf2e30bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.347108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba89483-a50c-4f5c-a4b7-c0baf2e30bda None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.347530 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba89483-a50c-4f5c-a4b7-c0baf2e30bda None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.348024 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba89483-a50c-4f5c-a4b7-c0baf2e30bda None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.349421 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba89483-a50c-4f5c-a4b7-c0baf2e30bda None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.351048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba89483-a50c-4f5c-a4b7-c0baf2e30bda None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.353092 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 62/121] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:57.359559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60c78d-27db-45b7-8490-75aba33670b5 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.359559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60c78d-27db-45b7-8490-75aba33670b5 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.359559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60c78d-27db-45b7-8490-75aba33670b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.379541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-4c60c78d-27db-45b7-8490-75aba33670b5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:57.381071 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4c60c78d-27db-45b7-8490-75aba33670b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:57.385786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.396605 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464496f-f5b7-497d-be94-3c644fcf3540 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.434850 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.435807 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.436276 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.436796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.464383 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 63/122] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:57.465387 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60c78d-27db-45b7-8490-75aba33670b5 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.519115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.520998 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.575076 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60c78d-27db-45b7-8490-75aba33670b5 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.616275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.617144 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.617342 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.617623 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.618760 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.620329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.621465 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.623081 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 64/123] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:57.624217 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.629007 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.634037 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 60/124] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:57.640136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.739588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4246409-9f9d-400f-8160-7ac4d4a7263c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.750503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6ae2-2f4e-4759-88b2-24c8f63abe46 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.776782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.777515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.777868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.778215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.789079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.790033 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.790484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.790955 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.791435 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:57.792440 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.794101 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.796448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 61/125] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:57.797326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:57.798177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:38:57.798932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 65/126] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:57.799783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.802625 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.861598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.865076 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:57.905458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a329-7a91-49fd-b466-ddad8f67db2a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.914560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1263c-23ae-43fb-b6d1-45216ab00f20 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:57.941879 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.942791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.943236 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.943824 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/5bba93f9467f41078298f40969593ca0/roles/c31d5cb4bf2d4d89863537cb77b66262` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.946539 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] RBAC: Authorizing `identity:create_grant(project_id=9c774aab3a3f410cbe5fda133641dc5c, user_id=5bba93f9467f41078298f40969593ca0, role_id=c31d5cb4bf2d4d89863537cb77b66262)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.948254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.952713 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:57.953560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:57.954018 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:57.954554 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:57.955498 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] RBAC: Adding query filter params (role.id=b582cb49cc524493b32b0a2dbf57afc5, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=f3fd6d8121804a2188a0bf1add448daa) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:57.956020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:57.957933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:57.964823 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 66/127] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/role_assignments?user.id=f3fd6d8121804a2188a0bf1add448daa&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=b582cb49cc524493b32b0a2dbf57afc5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:57.965791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:57.966035 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 62/128] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:38:57 2022] PUT /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/5bba93f9467f41078298f40969593ca0/roles/c31d5cb4bf2d4d89863537cb77b66262 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:38:57.967162 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:58.085429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af8b0-6ffa-4a8a-8f6e-8c45696d815a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:58.110476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:58.128156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:58.129278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:58.129932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:58.130546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:58.153391 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:38:58.162160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:38:58.163095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:38:58.163957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:38:58.167723 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 63/129] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:38:58.174991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:58.184095 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce61f0-370f-4839-939b-7db642f5fa18 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:58.232087 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:58.274881 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:58.275965 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:58.276444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:58.276991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:58.277873 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:58.278420 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:58.280115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:58.291417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 67/130] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:58.297731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:58.353931 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507a93e-61f1-4b8a-ab9b-f624650d3bf4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:58.412199 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:58.413188 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:58.413644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:58.414116 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:58.418026 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:38:58.418526 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:58.420197 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:58.442001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 64/131] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:58.445563 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:58.448009 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be8cc2-2c12-4cef-8798-6a079b327776 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:58.529440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:58.530786 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:58.531251 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:58.531730 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] PATH_INFO: `/v3/users/b314b21b589848739470473da31c8430` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:58.533236 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] RBAC: Authorizing `identity:get_user(user_id=b314b21b589848739470473da31c8430)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:58.536406 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:58.541495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 68/132] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:58 2022] GET /identity/v3/users/b314b21b589848739470473da31c8430 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:58.542048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:58.548213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:58.659589 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:58.661211 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1719fa4-95db-4cb6-bdc0-ad087f9a79e6 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:58.702823 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:58.703803 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:58.704398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:58.704905 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:58.706370 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:58.708077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:58.709904 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 65/133] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:38:58 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:58.715441 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:58.800856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50826d45-9af9-4562-94a4-5d44f6814df4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:58.826331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b34dd2-2bd8-4e62-827c-c82cfee774f4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:58.856663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:58.891448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:58.892417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:58.892871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:58.893293 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] PATH_INFO: `/v3/projects/deaea8465611475b98b19ab827dd1142` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:58.897468 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] RBAC: Authorizing `identity:get_project(project_id=deaea8465611475b98b19ab827dd1142)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:58.899141 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:58.900978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 66/134] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:58 2022] GET /identity/v3/projects/deaea8465611475b98b19ab827dd1142 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:38:58.907002 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:58.907586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:58.908069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:58.908345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:58.908633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:58.913355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:58.914764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:58.916431 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 69/135] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:38:58 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:38:58.925323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:38:59.035208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477371d-e42d-4a7b-b500-196c5cbe4a02 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:59.070271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d871f-9ef7-4e5a-a295-4d238bc20109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:59.071212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d871f-9ef7-4e5a-a295-4d238bc20109 None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:59.071731 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d871f-9ef7-4e5a-a295-4d238bc20109 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:59.072139 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d871f-9ef7-4e5a-a295-4d238bc20109 None admin] PATH_INFO: `/v3/projects/deaea8465611475b98b19ab827dd1142/users/5bba93f9467f41078298f40969593ca0/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:59.074396 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d871f-9ef7-4e5a-a295-4d238bc20109 None admin] RBAC: Authorizing `identity:create_grant(project_id=deaea8465611475b98b19ab827dd1142, user_id=5bba93f9467f41078298f40969593ca0, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:59.076555 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d871f-9ef7-4e5a-a295-4d238bc20109 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:59.091628 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 67/136] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:38:58 2022] PUT /identity/v3/projects/deaea8465611475b98b19ab827dd1142/users/5bba93f9467f41078298f40969593ca0/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:38:59.105014 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1a114-6582-4ea6-b975-3c732a16efe0 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:38:59.126987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:59.152657 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48726e98-0bf7-4168-a926-13b5f3cb1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:38:59.153374 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48726e98-0bf7-4168-a926-13b5f3cb1934 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:59.153646 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48726e98-0bf7-4168-a926-13b5f3cb1934 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:59.153923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48726e98-0bf7-4168-a926-13b5f3cb1934 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/b314b21b589848739470473da31c8430/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:59.155992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48726e98-0bf7-4168-a926-13b5f3cb1934 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c774aab3a3f410cbe5fda133641dc5c, user_id=b314b21b589848739470473da31c8430, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:38:59.157653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48726e98-0bf7-4168-a926-13b5f3cb1934 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:38:59.177822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 70/137] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:38:58 2022] PUT /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/b314b21b589848739470473da31c8430/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:38:59.551983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6d95-e0ea-4430-87bd-d3ed6126da9c None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:59.552744 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6d95-e0ea-4430-87bd-d3ed6126da9c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:59.553253 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6d95-e0ea-4430-87bd-d3ed6126da9c None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:59.554741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 68/138] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:38:59.560313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346ad0f-f025-4dc2-8898-efe631542dd5 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:38:59.561130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346ad0f-f025-4dc2-8898-efe631542dd5 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:38:59.561622 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346ad0f-f025-4dc2-8898-efe631542dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:38:59.580776 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-2346ad0f-f025-4dc2-8898-efe631542dd5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:38:59.582365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-2346ad0f-f025-4dc2-8898-efe631542dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:38:59.662313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 71/139] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:38:59.993071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a6d95-e0ea-4430-87bd-d3ed6126da9c None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:00.040898 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:00.120996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a6d95-e0ea-4430-87bd-d3ed6126da9c None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:00.170411 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19311277-7b35-4d71-ba9f-2dcba8e6e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:00.171680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311277-7b35-4d71-ba9f-2dcba8e6e9ef None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:00.172164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311277-7b35-4d71-ba9f-2dcba8e6e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:00.172669 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311277-7b35-4d71-ba9f-2dcba8e6e9ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:00.174075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19311277-7b35-4d71-ba9f-2dcba8e6e9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:00.175799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19311277-7b35-4d71-ba9f-2dcba8e6e9ef None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:00.177753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 69/140] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:00.184380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346ad0f-f025-4dc2-8898-efe631542dd5 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:00.315326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346ad0f-f025-4dc2-8898-efe631542dd5 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:00.325623 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:00.356935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4312f9-65fa-4609-b744-46161998b8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:00.357611 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4312f9-65fa-4609-b744-46161998b8a5 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:00.357892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4312f9-65fa-4609-b744-46161998b8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:00.358162 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4312f9-65fa-4609-b744-46161998b8a5 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:00.358824 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4312f9-65fa-4609-b744-46161998b8a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:00.360332 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4312f9-65fa-4609-b744-46161998b8a5 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:00.401097 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 72/141] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:00 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:00.647284 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813c142-ca98-4fd0-9c56-1d66f3e8a9c7 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:00.647659 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813c142-ca98-4fd0-9c56-1d66f3e8a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:00.647849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813c142-ca98-4fd0-9c56-1d66f3e8a9c7 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:00.649384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 70/142] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:00.655289 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520dd6-31b6-4cfd-8474-b3c54648f99d None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:00.655589 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520dd6-31b6-4cfd-8474-b3c54648f99d None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:00.655847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520dd6-31b6-4cfd-8474-b3c54648f99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:00.675488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-db520dd6-31b6-4cfd-8474-b3c54648f99d None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:00.676753 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-db520dd6-31b6-4cfd-8474-b3c54648f99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:00.749280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 73/143] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:01.070571 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4102ea3-6f3c-455d-9845-0ad417263122 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:01.071069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4102ea3-6f3c-455d-9845-0ad417263122 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:01.071165 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4102ea3-6f3c-455d-9845-0ad417263122 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:01.072592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 71/144] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:01.078475 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d670d-08bf-4477-ad5e-b9f6df66d9c5 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:01.078764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d670d-08bf-4477-ad5e-b9f6df66d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:01.079036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d670d-08bf-4477-ad5e-b9f6df66d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:01.100693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-a42d670d-08bf-4477-ad5e-b9f6df66d9c5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:01.102237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-a42d670d-08bf-4477-ad5e-b9f6df66d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:01.107293 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4102ea3-6f3c-455d-9845-0ad417263122 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:01.196862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 74/145] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:01.287007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4102ea3-6f3c-455d-9845-0ad417263122 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:01.299600 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:01.333238 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:01.333807 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:01.334083 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:01.334355 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:01.348979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:01.353964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:01.354914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:01.355795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 72/146] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:01.364035 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d670d-08bf-4477-ad5e-b9f6df66d9c5 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:01.398905 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:01.489106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d670d-08bf-4477-ad5e-b9f6df66d9c5 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:01.530102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a879ab-6d8a-42b8-bf74-30268e65a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:01.530825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a879ab-6d8a-42b8-bf74-30268e65a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:01.531109 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a879ab-6d8a-42b8-bf74-30268e65a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:01.531382 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a879ab-6d8a-42b8-bf74-30268e65a9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:01.532067 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a879ab-6d8a-42b8-bf74-30268e65a9a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:01.532369 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a879ab-6d8a-42b8-bf74-30268e65a9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:01.534015 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a879ab-6d8a-42b8-bf74-30268e65a9a3 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:01.548167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 75/147] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:01.555149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:01.686655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f72a-1f74-4e23-b286-634a947bb000 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:01.687005 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f72a-1f74-4e23-b286-634a947bb000 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:01.687181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f72a-1f74-4e23-b286-634a947bb000 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:01.688785 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 76/148] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:01.693564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf074f0-36fa-4b3b-babe-9da8a4ec3c33 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:01.695046 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495c75-028c-4e36-89cd-b50b472e70e7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:01.695612 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495c75-028c-4e36-89cd-b50b472e70e7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:01.696070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495c75-028c-4e36-89cd-b50b472e70e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:01.734718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-55495c75-028c-4e36-89cd-b50b472e70e7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:01.736345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-55495c75-028c-4e36-89cd-b50b472e70e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:01.753983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:01.754890 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:01.755306 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:01.755713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:01.757046 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:01.758740 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:01.760848 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 73/149] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:01 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:01.770208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:01.817586 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:01.864270 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 77/150] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:01.880153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495c75-028c-4e36-89cd-b50b472e70e7 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:01.900764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:01.935449 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421953-7e92-4560-b959-ff24a75fdada None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.003996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:02.004945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.005376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.005790 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.056113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495c75-028c-4e36-89cd-b50b472e70e7 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.108356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:02.111011 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:02.117128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:02.119174 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.119870 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.120809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.143098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:02.149867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:02.150915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:02.151871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:02.157807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 78/151] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:02.163766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:02.185985 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:02.266341 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:02.301421 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862bd79-39d0-4d46-8751-9317e57239ff None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.326519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 74/152] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:02.332330 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:02.342264 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:02.343148 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.343576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.343993 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.344859 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:02.345298 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:02.346861 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:02.357544 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 79/153] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:02.363801 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:02.473623 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311f94-c485-46ab-919d-c07ab0731fc1 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.510003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:02.510882 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.511323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.511743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.513070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:02.514774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:02.516728 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 80/154] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:02 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:02.517662 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:02.521498 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:02.540541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0193ee2-7ce5-47e8-b991-e85649e4323c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.623078 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a0e73-8a4a-4e36-814b-cdf105e551b8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.629947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:02.630609 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.630886 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.631160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.637355 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:02.638935 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:02.640646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 75/155] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:02 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:02.641516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:02.644580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:02.660742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90c89d-a3c6-49e0-baee-31f40b4fe31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:02.661621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c89d-a3c6-49e0-baee-31f40b4fe31b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.662037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c89d-a3c6-49e0-baee-31f40b4fe31b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.662448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c89d-a3c6-49e0-baee-31f40b4fe31b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.674101 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90c89d-a3c6-49e0-baee-31f40b4fe31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-3f90c89d-a3c6-49e0-baee-31f40b4fe31b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:02.679911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:02.681206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:02.682229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:02.684230 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 81/156] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:02.686001 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf84f-0510-43f0-99e5-dcd19f338936 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.686426 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf84f-0510-43f0-99e5-dcd19f338936 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.686848 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf84f-0510-43f0-99e5-dcd19f338936 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.688298 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 82/157] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:02.689192 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf84f-0510-43f0-99e5-dcd19f338936 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:02.762780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:02.799300 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf84f-0510-43f0-99e5-dcd19f338936 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.837263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:02.838766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:02.839208 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:02.839652 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:02.840695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=5bba93f9467f41078298f40969593ca0) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:02.841206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:02.844774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:02.851861 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 83/158] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:02 2022] GET /identity/v3/role_assignments?user.id=5bba93f9467f41078298f40969593ca0&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:02.854037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:02.949677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee03fee-b19c-49a1-9b29-ec1e84ca760e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:02.978963 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da343a-28b8-4519-806c-f77ae8f5c9d7 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:03.009928 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a33fcd-832c-4943-be3a-c5c5dfaffec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:03.010574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a33fcd-832c-4943-be3a-c5c5dfaffec4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.010863 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a33fcd-832c-4943-be3a-c5c5dfaffec4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.011127 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a33fcd-832c-4943-be3a-c5c5dfaffec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.016577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:03.021272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32238dfa-5271-4d41-9fed-d0f185011535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:03.022331 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32238dfa-5271-4d41-9fed-d0f185011535 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.022833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32238dfa-5271-4d41-9fed-d0f185011535 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.023296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32238dfa-5271-4d41-9fed-d0f185011535 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.024318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32238dfa-5271-4d41-9fed-d0f185011535 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:03.024893 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32238dfa-5271-4d41-9fed-d0f185011535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:03.026739 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32238dfa-5271-4d41-9fed-d0f185011535 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:03.040143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 84/159] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:03.042115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4adc4-9744-41ce-9141-f371596b1e83 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.042696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4adc4-9744-41ce-9141-f371596b1e83 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.043180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4adc4-9744-41ce-9141-f371596b1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.064238 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-71b4adc4-9744-41ce-9141-f371596b1e83 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:03.065918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-71b4adc4-9744-41ce-9141-f371596b1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:03.152602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a33fcd-832c-4943-be3a-c5c5dfaffec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:03.154215 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a33fcd-832c-4943-be3a-c5c5dfaffec4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:03.156711 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:03.194237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 85/160] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:03.195690 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4adc4-9744-41ce-9141-f371596b1e83 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:03.295755 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 76/161] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:03.300006 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b827f-9407-47e8-bbfd-1d0eabf5cc54 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.300300 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b827f-9407-47e8-bbfd-1d0eabf5cc54 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.300579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b827f-9407-47e8-bbfd-1d0eabf5cc54 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.302303 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 77/162] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:03.304189 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b827f-9407-47e8-bbfd-1d0eabf5cc54 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:03.351024 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4adc4-9744-41ce-9141-f371596b1e83 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:03.395287 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:03.414577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a51848-221e-46ce-8bf2-7a534c0dd5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:03.415243 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51848-221e-46ce-8bf2-7a534c0dd5a5 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.415949 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51848-221e-46ce-8bf2-7a534c0dd5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.416239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51848-221e-46ce-8bf2-7a534c0dd5a5 None admin] PATH_INFO: `/v3/users/f3fd6d8121804a2188a0bf1add448daa` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.417556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a51848-221e-46ce-8bf2-7a534c0dd5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=f3fd6d8121804a2188a0bf1add448daa)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:03.419111 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a51848-221e-46ce-8bf2-7a534c0dd5a5 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:03.421374 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 86/163] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:03 2022] GET /identity/v3/users/f3fd6d8121804a2188a0bf1add448daa => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:03.423118 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25fd50-f266-434e-8d9a-e288ecc8ea5d None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.423597 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25fd50-f266-434e-8d9a-e288ecc8ea5d None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.423879 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25fd50-f266-434e-8d9a-e288ecc8ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.451654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-ff25fd50-f266-434e-8d9a-e288ecc8ea5d None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:03.453119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-ff25fd50-f266-434e-8d9a-e288ecc8ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:03.530410 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b827f-9407-47e8-bbfd-1d0eabf5cc54 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:03.532234 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:03.549434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 87/164] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:03.550389 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25fd50-f266-434e-8d9a-e288ecc8ea5d None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:03.618792 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:03.619354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.619626 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.619912 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.625293 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:03.626753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:03.628750 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 78/165] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:03 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:03.637329 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:03.726934 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25fd50-f266-434e-8d9a-e288ecc8ea5d None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:03.754434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:03.792649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:03.793302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.793584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.793857 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.795246 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:03.796969 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:03.798529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 88/166] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:03 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:03.805770 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:03.808397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98866bf6-7283-4615-ade3-8851ac421c24 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:03.846939 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:03.847900 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:03.848368 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:03.848874 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:03.849821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] RBAC: Adding query filter params (role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=5bba93f9467f41078298f40969593ca0) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:03.850320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:03.851961 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:03.867658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 79/167] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:03 2022] GET /identity/v3/role_assignments?user.id=5bba93f9467f41078298f40969593ca0&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:03.896541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:03.967117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc3e1-8fb3-469d-a88d-492a3bfa21dd None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:03.968874 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:04.027866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:04.028555 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:04.028850 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:04.029194 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/f3fd6d8121804a2188a0bf1add448daa/roles/b582cb49cc524493b32b0a2dbf57afc5` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:04.034998 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c774aab3a3f410cbe5fda133641dc5c, user_id=f3fd6d8121804a2188a0bf1add448daa, role_id=b582cb49cc524493b32b0a2dbf57afc5)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:04.037022 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:04.074839 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 89/168] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:39:03 2022] PUT /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/users/f3fd6d8121804a2188a0bf1add448daa/roles/b582cb49cc524493b32b0a2dbf57afc5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:39:04.100818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bd279-5962-4b06-96b1-722aecd5cf8d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:04.148844 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:04.149602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:04.149877 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:04.150157 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:04.167206 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:04.172817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:04.173932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:04.174720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 80/169] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:04.180151 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:04.223616 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:04.248529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:04.331359 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24965-2cb8-4305-b536-f6ce9f767f81 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:04.386838 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:04.387490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:04.387808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:04.388077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:04.389129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:04.389430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:04.390937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:04.400271 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 90/170] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:04.413225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:04.414363 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:04.419187 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7208f-ee61-4f18-b9bb-7e597354e5ed None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:04.474573 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:04.475228 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:04.475505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:04.475774 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:04.493169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:04.498216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:04.499092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:04.499876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 81/171] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:04.510965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:04.565871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb94cdb-c194-486d-aa28-11177658de56 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:04.578345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:04.607152 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:04.607801 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:04.608084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:04.608344 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] PATH_INFO: `/v3/users/b314b21b589848739470473da31c8430` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:04.609551 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] RBAC: Authorizing `identity:get_user(user_id=b314b21b589848739470473da31c8430)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:04.611593 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:04.613928 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 91/172] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:04 2022] GET /identity/v3/users/b314b21b589848739470473da31c8430 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:04.619357 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:04.674479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a7c0b-f008-4d08-8c9d-7f8e4bb4ad93 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:04.717493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:04.718288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:04.718569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:04.718838 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:04.719522 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:04.719819 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:04.724660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:04.732448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 82/173] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:04.742094 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:04.782351 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:04.814581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0b3d-064d-482b-9c78-97821c289022 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:04.886364 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d2b0b-90c1-446d-90b7-c73f2af1dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:04.886987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d2b0b-90c1-446d-90b7-c73f2af1dc21 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:04.887262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d2b0b-90c1-446d-90b7-c73f2af1dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:04.887532 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d2b0b-90c1-446d-90b7-c73f2af1dc21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:04.962254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:04.967062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d76cf0-8ca2-4ff9-a241-65d882291517 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:05.006660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75f0c1-673a-422c-9967-815aae0766d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:05.007746 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f0c1-673a-422c-9967-815aae0766d9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.008241 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f0c1-673a-422c-9967-815aae0766d9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.008926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f0c1-673a-422c-9967-815aae0766d9 None admin] PATH_INFO: `/v3/users/5bba93f9467f41078298f40969593ca0` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.010361 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75f0c1-673a-422c-9967-815aae0766d9 None admin] RBAC: Authorizing `identity:get_user(user_id=5bba93f9467f41078298f40969593ca0)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:05.012111 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75f0c1-673a-422c-9967-815aae0766d9 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:05.014350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 83/174] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:04 2022] GET /identity/v3/users/5bba93f9467f41078298f40969593ca0 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:05.015786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d761-0a12-44a2-bf0a-0901cdf81670 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.016217 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d761-0a12-44a2-bf0a-0901cdf81670 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.016658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d761-0a12-44a2-bf0a-0901cdf81670 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.026209 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d2b0b-90c1-446d-90b7-c73f2af1dc21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:05.026209 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d2b0b-90c1-446d-90b7-c73f2af1dc21 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:05.026947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 84/175] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:05.028091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d761-0a12-44a2-bf0a-0901cdf81670 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:05.185708 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 92/176] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 17:39:05.187336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f6779-a5ed-4bc5-a626-863208ac4315 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.194308 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f6779-a5ed-4bc5-a626-863208ac4315 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.194866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f6779-a5ed-4bc5-a626-863208ac4315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.209273 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:05.229341 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-6b4f6779-a5ed-4bc5-a626-863208ac4315 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:05.231474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-6b4f6779-a5ed-4bc5-a626-863208ac4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:05.247796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d761-0a12-44a2-bf0a-0901cdf81670 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:05.323692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:05.324827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.325328 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.325915 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.375966 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 93/177] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:05.378007 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f6779-a5ed-4bc5-a626-863208ac4315 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:05.397139 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:05.449656 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:05.451686 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:05.552691 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:05.575029 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 85/178] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:05.581623 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:05.626794 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f6779-a5ed-4bc5-a626-863208ac4315 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:05.703875 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:05.704702 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.704980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.705251 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.706406 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:05.707933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:05.709679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 94/179] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:05 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:05.715522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:05.769525 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054f0e-f25b-4023-8739-c96f17a7f66f None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:05.800701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:05.821983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decd535-bdbb-48bf-8215-d53315d9e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:05.822564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decd535-bdbb-48bf-8215-d53315d9e736 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.822835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decd535-bdbb-48bf-8215-d53315d9e736 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.823098 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decd535-bdbb-48bf-8215-d53315d9e736 None admin] PATH_INFO: `/v3/projects/deaea8465611475b98b19ab827dd1142` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.827309 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2e33-7e9f-45ca-b23b-bd5930e51dda None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:05.829345 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decd535-bdbb-48bf-8215-d53315d9e736 None admin] RBAC: Authorizing `identity:get_project(project_id=deaea8465611475b98b19ab827dd1142)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:05.830813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decd535-bdbb-48bf-8215-d53315d9e736 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:05.832864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 86/180] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:05 2022] GET /identity/v3/projects/deaea8465611475b98b19ab827dd1142 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:05.834035 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744224b9-8970-48f8-9820-c7c0dee8a579 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.834310 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744224b9-8970-48f8-9820-c7c0dee8a579 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.834579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744224b9-8970-48f8-9820-c7c0dee8a579 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.835759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 87/181] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:05.846849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d00dc-2bf2-4d62-b058-c0c1086c8980 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.847156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d00dc-2bf2-4d62-b058-c0c1086c8980 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.847394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d00dc-2bf2-4d62-b058-c0c1086c8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.868173 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:05.868897 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:05.869225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:05.869492 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:05.870382 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=b314b21b589848739470473da31c8430) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:05.870696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:05.872367 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:05.880092 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 95/182] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:05 2022] GET /identity/v3/role_assignments?user.id=b314b21b589848739470473da31c8430&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=1122faa21ccf460d936f2efb595661ff => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:05.881055 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:05.897747 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-406d00dc-2bf2-4d62-b058-c0c1086c8980 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:05.898989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-406d00dc-2bf2-4d62-b058-c0c1086c8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:06.009882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:06.017114 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c2adf-0ecc-441c-b0e4-d2a01a0c87eb None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.046715 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 88/183] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:06.047598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d00dc-2bf2-4d62-b058-c0c1086c8980 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.085423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676201e8-cb48-4ed0-bcd6-3b8cf23d37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.086379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676201e8-cb48-4ed0-bcd6-3b8cf23d37de None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.086850 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676201e8-cb48-4ed0-bcd6-3b8cf23d37de None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.087353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676201e8-cb48-4ed0-bcd6-3b8cf23d37de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.088294 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676201e8-cb48-4ed0-bcd6-3b8cf23d37de None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=deaea8465611475b98b19ab827dd1142, user.id=5bba93f9467f41078298f40969593ca0) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:06.088817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676201e8-cb48-4ed0-bcd6-3b8cf23d37de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:06.090476 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676201e8-cb48-4ed0-bcd6-3b8cf23d37de None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:06.110647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 96/184] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:05 2022] GET /identity/v3/role_assignments?user.id=5bba93f9467f41078298f40969593ca0&scope.project.id=deaea8465611475b98b19ab827dd1142&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:06.112269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de74dc-4e4b-41fe-8f30-db19370d5d57 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.112800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de74dc-4e4b-41fe-8f30-db19370d5d57 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.113271 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de74dc-4e4b-41fe-8f30-db19370d5d57 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.114684 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 97/185] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:06.120677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2b6da-ec72-4376-a3fd-9dea96ba7dd6 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.121310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2b6da-ec72-4376-a3fd-9dea96ba7dd6 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.121807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2b6da-ec72-4376-a3fd-9dea96ba7dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.139002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:06.165786 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-f2b2b6da-ec72-4376-a3fd-9dea96ba7dd6 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:06.167393 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-f2b2b6da-ec72-4376-a3fd-9dea96ba7dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:06.180193 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d00dc-2bf2-4d62-b058-c0c1086c8980 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.224163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.224910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.225414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.225684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.240774 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:06.246254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:06.247108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:06.247952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 89/186] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:06.253840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.296292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 98/187] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:06.306564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:06.369904 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d2e5e-96e1-4617-ae3c-f5737817dce5 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.408071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.409096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.409589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.410049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.410910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:06.411400 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:06.413006 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:06.425786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 90/188] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:06.431852 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2b6da-ec72-4376-a3fd-9dea96ba7dd6 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.454092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.542014 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2b6da-ec72-4376-a3fd-9dea96ba7dd6 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.571239 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b2deb-aaa4-4680-b64c-e1d983a1a4d1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.573487 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:06.575169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:06.580603 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.581481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.581911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.582365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] PATH_INFO: `/v3/users/001c65d7373e4b1eb3b0abc263e553f7` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.597621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] RBAC: Authorizing `identity:get_user(user_id=001c65d7373e4b1eb3b0abc263e553f7)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:06.599256 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:06.602346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 99/189] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/users/001c65d7373e4b1eb3b0abc263e553f7 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:06.608474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.616125 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.617048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.617475 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.617885 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.631794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:06.637710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:06.638720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:06.639700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:06.642218 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 91/190] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:06.650569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.741679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b20aa-28e9-47d3-832d-7faa5223b409 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.778716 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7781a-5d23-492b-9a86-791c4d9165f7 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.782824 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.783541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.783841 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.784078 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.814609 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.815511 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.815789 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.816055 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.816759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:06.817053 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:06.818439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:06.827323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 92/191] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:06.828149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.849654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:06.860234 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:06.860846 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:06.862444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:06.947159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714fdbb-5514-43c3-8e2e-634d8245e775 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:06.979273 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 100/192] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:06.980348 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:06.984965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:06.985620 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:06.985896 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:06.986163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:06.987285 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:06.988784 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:06.990355 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 93/193] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:06.991113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:07.094511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:07.106204 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ec1c4-c6d5-4608-b493-f97edafc48de None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:07.107740 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:07.116776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ee4d-f844-4d34-9802-58cdea84c935 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:07.145956 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:07.146598 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.146873 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.147142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] PATH_INFO: `/v3/users/001c65d7373e4b1eb3b0abc263e553f7` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.148275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] RBAC: Authorizing `identity:get_user(user_id=001c65d7373e4b1eb3b0abc263e553f7)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:07.149829 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:07.151575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 101/194] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/users/001c65d7373e4b1eb3b0abc263e553f7 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:07.152198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:07.157366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:07.158015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.158289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.158556 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.159834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:07.161336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:07.163246 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 94/195] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:06 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:07.164015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:07.265543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147dcee-6c73-4eb6-bfd1-a557f4eab325 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:07.268873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c528-cbf3-4894-8551-dbd79821cc9b None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:07.299524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:07.300133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.300404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.300766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.301438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:07.302574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:07.302918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:07.303181 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.303452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.303716 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.325561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 102/196] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:07 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:07.326701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:07.346379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:07.350012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:07.396352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:07.397917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:07.464881 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23e28-aa99-40e5-b15e-d1e2c4526843 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:07.504436 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0305a4-6ba7-4366-b808-e4d298efaddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:07.505074 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0305a4-6ba7-4366-b808-e4d298efaddd None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.505366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0305a4-6ba7-4366-b808-e4d298efaddd None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.505629 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0305a4-6ba7-4366-b808-e4d298efaddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.506350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0305a4-6ba7-4366-b808-e4d298efaddd None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=001c65d7373e4b1eb3b0abc263e553f7) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:07.506657 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0305a4-6ba7-4366-b808-e4d298efaddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:07.508117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0305a4-6ba7-4366-b808-e4d298efaddd None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:07.515403 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 95/197] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:07.515606 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 103/198] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:07 2022] GET /identity/v3/role_assignments?user.id=001c65d7373e4b1eb3b0abc263e553f7&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=1122faa21ccf460d936f2efb595661ff => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:07.520826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e7ca-8359-44a6-8d51-cc9b1c1e2b08 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.520826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e7ca-8359-44a6-8d51-cc9b1c1e2b08 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.520826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e7ca-8359-44a6-8d51-cc9b1c1e2b08 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.520826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 104/199] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:07.522400 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:07.527854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf2f7-4207-43ba-8330-1ed324f37d72 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.528129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf2f7-4207-43ba-8330-1ed324f37d72 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.530348 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf2f7-4207-43ba-8330-1ed324f37d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.549529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e33cf2f7-4207-43ba-8330-1ed324f37d72 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:07.551207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e33cf2f7-4207-43ba-8330-1ed324f37d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:07.621666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:07.654390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 105/200] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:07.677444 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1dc76-2203-4c97-9aa4-4420dea613fe None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:07.716135 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:07.716859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.717136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.717402 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.718584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:07.720054 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:07.721945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 96/201] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:07 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:07.727686 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf2f7-4207-43ba-8330-1ed324f37d72 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:07.741317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:07.840761 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf2f7-4207-43ba-8330-1ed324f37d72 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:07.875665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:07.876273 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:07.876543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:07.876842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:07.877562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] RBAC: Adding query filter params (role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=001c65d7373e4b1eb3b0abc263e553f7) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:07.877859 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:07.879374 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:07.885186 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 106/202] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:07 2022] GET /identity/v3/role_assignments?user.id=001c65d7373e4b1eb3b0abc263e553f7&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:08.009221 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:08.131071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff3d2-4f1a-408f-bb9a-175f2befb9da None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:08.160832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:08.168020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:08.168702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:08.168981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:08.169300 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:08.189763 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:08.194835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:08.195718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:08.196500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 97/203] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:08.202084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:08.313685 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:08.348917 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893c86d-a64d-42c5-8177-f24cc5dc5826 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:08.387243 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:08.387779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:08.388398 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:08.388703 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:08.389368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:08.389664 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:08.391044 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:08.401689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 107/204] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:08.407531 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:08.537789 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda9cdd-0104-4792-ba8b-83b1e0b372e2 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:08.587155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:08.587794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:08.588071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:08.588338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] PATH_INFO: `/v3/users/f3fd6d8121804a2188a0bf1add448daa` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:08.589509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] RBAC: Authorizing `identity:get_user(user_id=f3fd6d8121804a2188a0bf1add448daa)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:08.590988 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:08.593160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 98/205] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:08 2022] GET /identity/v3/users/f3fd6d8121804a2188a0bf1add448daa => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:08.598941 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:08.701623 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bafe1-f338-47a5-9c08-5c1bbb676069 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:08.735350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:08.736047 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:08.736337 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:08.736600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:08.739353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:08.832119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:08.833616 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:08.969428 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 108/206] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:08.975335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:09.060485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:09.105169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf3e4-7afa-4304-b276-d29e8bfae71c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:09.144052 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3760-df0a-432b-bc64-3c1184befa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:09.145104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3760-df0a-432b-bc64-3c1184befa8b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:09.145571 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3760-df0a-432b-bc64-3c1184befa8b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:09.146043 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3760-df0a-432b-bc64-3c1184befa8b None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:09.150257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3760-df0a-432b-bc64-3c1184befa8b None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:09.151910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3760-df0a-432b-bc64-3c1184befa8b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:09.153907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 99/207] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:08 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:09.161248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:09.219179 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:09.310847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11e651-4707-4f5d-beb1-7d8a7713b344 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:09.358008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231476cb-f442-4eb0-a6a8-3b9b046c06db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:09.358635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231476cb-f442-4eb0-a6a8-3b9b046c06db None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:09.358911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231476cb-f442-4eb0-a6a8-3b9b046c06db None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:09.359182 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231476cb-f442-4eb0-a6a8-3b9b046c06db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:09.359922 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231476cb-f442-4eb0-a6a8-3b9b046c06db None admin] RBAC: Adding query filter params (role.id=b582cb49cc524493b32b0a2dbf57afc5, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c, user.id=f3fd6d8121804a2188a0bf1add448daa) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:09.360225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231476cb-f442-4eb0-a6a8-3b9b046c06db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:09.361719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231476cb-f442-4eb0-a6a8-3b9b046c06db None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:09.371265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 109/208] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:09 2022] GET /identity/v3/role_assignments?user.id=f3fd6d8121804a2188a0bf1add448daa&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=b582cb49cc524493b32b0a2dbf57afc5 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:10.298294 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaf738-7858-4bf2-817e-1b475b220ee4 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.299284 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaf738-7858-4bf2-817e-1b475b220ee4 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.299776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaf738-7858-4bf2-817e-1b475b220ee4 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.301617 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 100/209] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:10.307079 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9593c-1be8-429e-ae71-ed8adf2529d7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.307903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9593c-1be8-429e-ae71-ed8adf2529d7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.308366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9593c-1be8-429e-ae71-ed8adf2529d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.325128 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c36b5-f6ec-4de1-affd-58ffe8107b14 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.325804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c36b5-f6ec-4de1-affd-58ffe8107b14 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.326268 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c36b5-f6ec-4de1-affd-58ffe8107b14 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.328249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 101/210] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:10.328559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-cfa9593c-1be8-429e-ae71-ed8adf2529d7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:10.329793 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-cfa9593c-1be8-429e-ae71-ed8adf2529d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:10.338138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7322-cbca-4fac-9299-c4fca7f15152 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.338725 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7322-cbca-4fac-9299-c4fca7f15152 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.339208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7322-cbca-4fac-9299-c4fca7f15152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.362377 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-f75f7322-cbca-4fac-9299-c4fca7f15152 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:10.364825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-f75f7322-cbca-4fac-9299-c4fca7f15152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:10.405286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 110/211] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:10.441506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405a89-96a9-4f82-86db-eb88a16714b4 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.442117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405a89-96a9-4f82-86db-eb88a16714b4 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.442585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405a89-96a9-4f82-86db-eb88a16714b4 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.444434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 111/212] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:10.450676 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e345-e72b-4121-b054-7565e523db51 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.451177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e345-e72b-4121-b054-7565e523db51 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.451660 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e345-e72b-4121-b054-7565e523db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.455108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 102/213] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:10.472549 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-30d1e345-e72b-4121-b054-7565e523db51 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:10.474055 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-30d1e345-e72b-4121-b054-7565e523db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:10.498784 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:10.534136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49fb1b-3533-4b76-b4a1-7873f47716d6 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.534776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49fb1b-3533-4b76-b4a1-7873f47716d6 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.535236 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49fb1b-3533-4b76-b4a1-7873f47716d6 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.536802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 103/214] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:10.541711 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665be28-c699-4f38-9792-cdb6670139d3 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.542189 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665be28-c699-4f38-9792-cdb6670139d3 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.542665 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665be28-c699-4f38-9792-cdb6670139d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.547988 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 112/215] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:10.561137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-1665be28-c699-4f38-9792-cdb6670139d3 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:10.562639 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-1665be28-c699-4f38-9792-cdb6670139d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:10.615014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:10.631724 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 104/216] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:10.748818 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e345-e72b-4121-b054-7565e523db51 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:10.790522 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665be28-c699-4f38-9792-cdb6670139d3 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:10.859938 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e345-e72b-4121-b054-7565e523db51 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:10.890574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665be28-c699-4f38-9792-cdb6670139d3 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:10.896437 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:10.897112 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.897389 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.897657 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.907938 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:10.912649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:10.913525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 113/217] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:10.917430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:10.930385 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:10.931076 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:10.931346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:10.931772 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:10.939008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:10.945740 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:10.950685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:10.951947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:10.952786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 105/218] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:10.953455 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.007045 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.030715 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477249fe-f441-4d2a-89ee-7cf6f15b3caf None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.058140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64cb2f-b4d1-4c66-88c7-e031cce5bff2 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.065792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.066426 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.066707 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.066988 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.068085 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.069900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.071478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 114/219] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.072243 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.093633 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.094234 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.094495 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.094762 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.095669 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:11.096354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.097776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.107789 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 106/220] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.108878 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.161110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.176337 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2b0c-1b5f-4034-a5c8-3d8d86132915 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.210351 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.210798 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac145a-f0d7-4b28-906e-1e39e95d9f7c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.210959 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.211237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.211507 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.212181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] RBAC: Adding query filter params (name=member) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:11.212480 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.213904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.219636 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.222420 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 115/221] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.223344 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.250378 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.251020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.251316 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.251588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.264714 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:11.270222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:11.271251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:11.272062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 107/222] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:11.272744 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.331941 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ea44-bc31-4328-8c0c-8445490cd91f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.365692 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.366299 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.366576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.366848 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.367485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.368954 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.370676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8663d4-3ed8-4f2b-99c1-7ed62fa263a7 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.390622 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 116/223] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:11 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:11.391579 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.394995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.417334 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.417967 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.418245 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.418513 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] PATH_INFO: `/v3/users/001c65d7373e4b1eb3b0abc263e553f7` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.419976 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] RBAC: Authorizing `identity:get_user(user_id=001c65d7373e4b1eb3b0abc263e553f7)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.421380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.423080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 108/224] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/users/001c65d7373e4b1eb3b0abc263e553f7 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.423080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.481237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.515867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b0398-e563-4ff8-a7b9-16559419f4bf None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.553958 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.554615 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.554888 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.555160 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] PATH_INFO: `/v3/users/3f1aa05c1bd5454eaab37be0d864260a` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.557293 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ccff5-f48c-485e-a87a-1c922537f269 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.570857 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] RBAC: Authorizing `identity:get_user(user_id=3f1aa05c1bd5454eaab37be0d864260a)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.572342 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.578574 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 117/225] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/users/3f1aa05c1bd5454eaab37be0d864260a => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.578574 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.601569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.604549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.604549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.604549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.604549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:11.604549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.605508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.620973 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 109/226] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.622233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.656416 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.708889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932af5-4e37-4f18-9a51-d5c7c09464c8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.750136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.753719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.754379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.754656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.754905 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ccc9-86b5-45b8-a507-a1b871b299eb None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.755001 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.756040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.757561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.760464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 118/227] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.760464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.799022 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.799455 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.799737 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.800007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.871244 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.872818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.875502 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb57f19-674e-4601-a63a-7e918f09b7ea None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:11.907335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.917415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:11.918369 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:11.918844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:11.919423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] PATH_INFO: `/v3/users/001c65d7373e4b1eb3b0abc263e553f7` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:11.920831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=001c65d7373e4b1eb3b0abc263e553f7)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:11.922621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:11.924713 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 119/228] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/users/001c65d7373e4b1eb3b0abc263e553f7 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:11.925956 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:11.988428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:11.999685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 110/229] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:12.000474 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:12.037288 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8102-2582-4d48-89d4-47aa8b4de8e4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:12.074794 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:12.075992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:12.076487 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:12.076990 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/001c65d7373e4b1eb3b0abc263e553f7/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:12.079630 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] RBAC: Authorizing `identity:create_grant(project_id=2310cdb9aaee4d6bb40f906576dd80ab, user_id=001c65d7373e4b1eb3b0abc263e553f7, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:12.081783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:12.103105 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 120/230] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:39:11 2022] PUT /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/001c65d7373e4b1eb3b0abc263e553f7/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:12.104776 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:12.129185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82287f12-4141-4b59-862f-3e65bb4bb134 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:12.171147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:12.171852 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:12.172136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:12.172412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:12.173617 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:12.176344 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:12.178510 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 111/231] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:11 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:12.186322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:12.243877 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:12.275513 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:12.307698 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4271ef-3bf8-4ef2-9fa7-baf068e1248a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:12.326005 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc003-188b-4224-a41d-00fb9a5f8962 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:12.347107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:12.348483 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:12.349027 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:12.349619 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:12.351025 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:12.352702 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:12.355037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 121/232] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:12 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:12.363249 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:12.369297 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b82dd-6aaf-48cb-bea3-cde862faf5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:12.370185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b82dd-6aaf-48cb-bea3-cde862faf5ce None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:12.370472 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b82dd-6aaf-48cb-bea3-cde862faf5ce None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:12.370794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b82dd-6aaf-48cb-bea3-cde862faf5ce None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/001c65d7373e4b1eb3b0abc263e553f7/roles/c31d5cb4bf2d4d89863537cb77b66262` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:12.373434 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b82dd-6aaf-48cb-bea3-cde862faf5ce None admin] RBAC: Authorizing `identity:create_grant(project_id=2310cdb9aaee4d6bb40f906576dd80ab, user_id=001c65d7373e4b1eb3b0abc263e553f7, role_id=c31d5cb4bf2d4d89863537cb77b66262)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:12.375137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b82dd-6aaf-48cb-bea3-cde862faf5ce None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:12.395949 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 112/233] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:39:12 2022] PUT /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/001c65d7373e4b1eb3b0abc263e553f7/roles/c31d5cb4bf2d4d89863537cb77b66262 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:39:12.492749 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748782-e5d1-40a1-a144-05a933f2a49e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:12.524867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:12.538925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865f535-5d33-4124-ae91-df23d2a5f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:12.539561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865f535-5d33-4124-ae91-df23d2a5f010 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:12.539829 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865f535-5d33-4124-ae91-df23d2a5f010 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:12.540096 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865f535-5d33-4124-ae91-df23d2a5f010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:12.540884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865f535-5d33-4124-ae91-df23d2a5f010 None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=3f1aa05c1bd5454eaab37be0d864260a) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:12.541189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865f535-5d33-4124-ae91-df23d2a5f010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:12.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865f535-5d33-4124-ae91-df23d2a5f010 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:12.550303 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 122/234] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:12 2022] GET /identity/v3/role_assignments?user.id=3f1aa05c1bd5454eaab37be0d864260a&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:14.007832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9416a-b417-4983-b095-6feafcd195d5 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:14.008459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9416a-b417-4983-b095-6feafcd195d5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:14.008459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9416a-b417-4983-b095-6feafcd195d5 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:14.010007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 113/235] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:14.015421 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854e45a-eced-4dd6-a9b4-b270c7e9d018 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:14.015815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854e45a-eced-4dd6-a9b4-b270c7e9d018 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:14.015977 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854e45a-eced-4dd6-a9b4-b270c7e9d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:14.045895 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-6854e45a-eced-4dd6-a9b4-b270c7e9d018 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:14.047181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-6854e45a-eced-4dd6-a9b4-b270c7e9d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:14.141438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 123/236] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:14.565254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0557e-bb4a-461e-aa86-2f9d4f9f042e None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:14.565936 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0557e-bb4a-461e-aa86-2f9d4f9f042e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:14.566420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0557e-bb4a-461e-aa86-2f9d4f9f042e None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:14.568564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 114/237] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:14.575636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7ca9-332f-4a9f-a0e6-a70d6bfa82c5 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:14.576158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7ca9-332f-4a9f-a0e6-a70d6bfa82c5 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:14.576677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7ca9-332f-4a9f-a0e6-a70d6bfa82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:14.601563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-399c7ca9-332f-4a9f-a0e6-a70d6bfa82c5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:14.603076 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-399c7ca9-332f-4a9f-a0e6-a70d6bfa82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:14.687045 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 124/238] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:14.732471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0557e-bb4a-461e-aa86-2f9d4f9f042e None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:14.917037 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0557e-bb4a-461e-aa86-2f9d4f9f042e None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:14.960458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:14.977317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:14.978309 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:14.978774 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:14.979269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:14.980605 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:14.982453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:14.984252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 115/239] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:15.003754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7ca9-332f-4a9f-a0e6-a70d6bfa82c5 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:15.066564 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:15.118113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:15.132166 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7ca9-332f-4a9f-a0e6-a70d6bfa82c5 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:15.194740 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d91de3-6cfb-47b3-b6c4-16db899c5625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:15.195252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91de3-6cfb-47b3-b6c4-16db899c5625 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.195529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91de3-6cfb-47b3-b6c4-16db899c5625 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.195786 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91de3-6cfb-47b3-b6c4-16db899c5625 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.196559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d91de3-6cfb-47b3-b6c4-16db899c5625 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:15.198135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d91de3-6cfb-47b3-b6c4-16db899c5625 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:15.243756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 125/240] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:15 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:15.245195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a6002-c7b7-4470-afbd-78805b64c6ba None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.245474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a6002-c7b7-4470-afbd-78805b64c6ba None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.245743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a6002-c7b7-4470-afbd-78805b64c6ba None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.247408 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 126/241] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:15.259923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb573a-643b-4a53-8ee3-c13e798f83ae None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.260307 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb573a-643b-4a53-8ee3-c13e798f83ae None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.260588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb573a-643b-4a53-8ee3-c13e798f83ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.269637 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47d0be-3240-424d-bc61-a34c174d5584 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:15.319450 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-cfdb573a-643b-4a53-8ee3-c13e798f83ae None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:15.320710 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-cfdb573a-643b-4a53-8ee3-c13e798f83ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:15.334210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:15.334870 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.337576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.337857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.365004 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:15.376319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:15.377278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:15.378490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 116/242] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:15.383880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:15.476565 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 127/243] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:15.492391 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:15.539945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cfa24-f390-41ae-bea7-137c4b138446 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:15.576152 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a12fc-8c47-4918-8427-877465bc5745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:15.577189 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a12fc-8c47-4918-8427-877465bc5745 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.577680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a12fc-8c47-4918-8427-877465bc5745 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.578137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a12fc-8c47-4918-8427-877465bc5745 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.578999 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a12fc-8c47-4918-8427-877465bc5745 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:15.579582 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a12fc-8c47-4918-8427-877465bc5745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:15.581178 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a12fc-8c47-4918-8427-877465bc5745 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:15.589880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 117/244] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:15.601884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb573a-643b-4a53-8ee3-c13e798f83ae None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:15.620080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278a54b-9aaf-4f68-8229-ca41216fd9a0 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.620738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278a54b-9aaf-4f68-8229-ca41216fd9a0 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.621222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278a54b-9aaf-4f68-8229-ca41216fd9a0 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.623445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 118/245] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:15.629210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25829ad6-12e4-44ff-b907-cba941bac244 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.629779 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25829ad6-12e4-44ff-b907-cba941bac244 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.630238 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25829ad6-12e4-44ff-b907-cba941bac244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.642633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:15.649632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-25829ad6-12e4-44ff-b907-cba941bac244 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:15.651073 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-25829ad6-12e4-44ff-b907-cba941bac244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:15.729925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb573a-643b-4a53-8ee3-c13e798f83ae None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:15.736747 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 119/246] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:15.777413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:15.778468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.779039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.779522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] PATH_INFO: `/v3/users/19bfe40272294b9e8e1de0dbaebb38ec` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.795036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=19bfe40272294b9e8e1de0dbaebb38ec)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:15.796885 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:15.798775 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 128/247] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:15 2022] GET /identity/v3/users/19bfe40272294b9e8e1de0dbaebb38ec => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:15.804399 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25829ad6-12e4-44ff-b907-cba941bac244 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:15.844464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:15.858171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:15.928077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25829ad6-12e4-44ff-b907-cba941bac244 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:15.976360 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:15.980392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55483269-23d4-409a-980c-7fff9d7f3056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:15.981377 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483269-23d4-409a-980c-7fff9d7f3056 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:15.982201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483269-23d4-409a-980c-7fff9d7f3056 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:15.982588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483269-23d4-409a-980c-7fff9d7f3056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:15.985485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330a81-27fd-441b-affc-f3680ad88ff6 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.025133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad5ef5-f271-40e0-824f-8dd6a6e8f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.026628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5ef5-f271-40e0-824f-8dd6a6e8f405 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.026914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5ef5-f271-40e0-824f-8dd6a6e8f405 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.027187 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5ef5-f271-40e0-824f-8dd6a6e8f405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.043554 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad5ef5-f271-40e0-824f-8dd6a6e8f405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-adad5ef5-f271-40e0-824f-8dd6a6e8f405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:16.049907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:16.050812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:16.051581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:16.056585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 129/248] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:16.061221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df1e2b-72a7-43ef-bb9d-cf4ffbd80181 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.061499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df1e2b-72a7-43ef-bb9d-cf4ffbd80181 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.061767 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df1e2b-72a7-43ef-bb9d-cf4ffbd80181 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.063124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 130/249] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:16.063840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df1e2b-72a7-43ef-bb9d-cf4ffbd80181 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.078151 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55483269-23d4-409a-980c-7fff9d7f3056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:16.079632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55483269-23d4-409a-980c-7fff9d7f3056 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:16.145460 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:16.194713 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df1e2b-72a7-43ef-bb9d-cf4ffbd80181 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.206077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 120/250] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 17:39:16.207581 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41094a-9656-4bdf-96e2-6f9693f5480f None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.207871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41094a-9656-4bdf-96e2-6f9693f5480f None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.208143 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41094a-9656-4bdf-96e2-6f9693f5480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.227975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-4f41094a-9656-4bdf-96e2-6f9693f5480f None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:16.229266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-4f41094a-9656-4bdf-96e2-6f9693f5480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:16.232975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.233533 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.233810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.234084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.234747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:16.235054 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:16.236453 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:16.245396 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 131/251] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:16.251038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.271559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:16.307649 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 121/252] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:16.308762 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41094a-9656-4bdf-96e2-6f9693f5480f None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.399155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:16.401992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1e5d7-5746-4e3e-923f-79931a32f13a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.450973 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41094a-9656-4bdf-96e2-6f9693f5480f None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.454445 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.455250 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.455666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.456073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.480503 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:16.489858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:16.490939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:16.491961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:16.499247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 132/253] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:16.500253 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.529992 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.530999 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.531416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.531823 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.533166 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:16.534977 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:16.536965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 122/254] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:16.537989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.609452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:16.633354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033ee0-47e8-4c22-9599-f9656376d755 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.666865 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9de4a-dabe-4090-9149-87977a90260f None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.667290 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.667924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.668202 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.668468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] PATH_INFO: `/v3/users/001c65d7373e4b1eb3b0abc263e553f7` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.669666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] RBAC: Authorizing `identity:get_user(user_id=001c65d7373e4b1eb3b0abc263e553f7)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:16.671547 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:16.673022 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 133/255] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/users/001c65d7373e4b1eb3b0abc263e553f7 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:16.673896 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.707421 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.708513 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.709068 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.709578 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.710461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:16.710951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:16.712572 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:16.722358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 123/256] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:16.723505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.737928 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:16.775621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75976011-4df9-472c-a18d-fbf36013ab86 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.809442 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.810101 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.810648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.810648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.811333 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] RBAC: Adding query filter params (role.id=b582cb49cc524493b32b0a2dbf57afc5, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=19bfe40272294b9e8e1de0dbaebb38ec) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:16.811632 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:16.813380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:16.819318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 134/257] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/role_assignments?user.id=19bfe40272294b9e8e1de0dbaebb38ec&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=b582cb49cc524493b32b0a2dbf57afc5 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:16.820168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:16.838916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa5b4-9062-4564-af61-0d86ce9662c6 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:16.841799 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:16.879099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:16.880135 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:16.880644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:16.881126 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:16.957215 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:16.959097 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:16.968039 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:17.000560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55842964-43c4-494c-b7ac-4a57bb1e91ae None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:17.057627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:17.058235 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:17.058507 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:17.058772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] PATH_INFO: `/v3/users/001c65d7373e4b1eb3b0abc263e553f7` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:17.060126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] RBAC: Authorizing `identity:get_user(user_id=001c65d7373e4b1eb3b0abc263e553f7)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:17.061700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:17.063598 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 135/258] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/users/001c65d7373e4b1eb3b0abc263e553f7 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:17.064238 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:17.084696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 124/259] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:17.085900 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:17.156157 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:17.182271 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb96fc-e4f6-4a93-9ac4-e8d3c74af852 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:17.238361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:17.239026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:17.239026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:17.239338 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:17.270880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1cc8-6697-4b5e-bb92-18f7e3507ffd None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:17.274699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:17.285086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:17.286945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:17.287967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 136/260] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:17.289620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:17.308078 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:17.308781 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:17.309331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:17.309481 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:17.381036 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:17.382741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:17.508640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 125/261] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:17.509498 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:17.518738 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a4136-008a-4f33-8962-a514226b0126 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:17.529370 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:17.581064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:17.581665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:17.581947 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:17.582219 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:17.583352 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:17.585971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:17.589031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 137/262] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:17.589798 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:17.601265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:17.694645 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4864-9925-449b-917c-62c0a54b5489 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:17.753702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:17.754332 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:17.754612 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:17.754882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:17.760649 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:17.760649 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:17.760649 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:17.766065 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 126/263] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:17.766913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:17.779411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e624011-ecbd-4756-9b76-b72f59089aeb None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:17.862254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:17.872869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:17.873526 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:17.873804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:17.874076 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:17.877443 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f079ab-09ff-4a6f-9037-b0cd5dcd704d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:17.879693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:17.881281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:17.884791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 138/264] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:17.885644 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:17.922387 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:17.923980 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:17.924156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:17.924434 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:17.925188 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=001c65d7373e4b1eb3b0abc263e553f7) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:17.925497 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:17.926942 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:17.941544 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 127/265] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/role_assignments?user.id=001c65d7373e4b1eb3b0abc263e553f7&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=1122faa21ccf460d936f2efb595661ff => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:17.943271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:18.012691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:18.071878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7098e9-f899-4b3a-a2cf-0dd13dd94c6e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:18.146188 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb52c4-45f1-4542-8600-4de03c8b24fe None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:18.169394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:18.170041 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.170317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.170585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] PATH_INFO: `/v3/users/3f1aa05c1bd5454eaab37be0d864260a` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.174056 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=3f1aa05c1bd5454eaab37be0d864260a)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:18.179755 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:18.181620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 139/266] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/users/3f1aa05c1bd5454eaab37be0d864260a => generated 297 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:18.187779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:18.205867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:18.210732 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99f605-b4c4-4a24-94d6-87005d862ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:18.211356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f605-b4c4-4a24-94d6-87005d862ede None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.211636 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f605-b4c4-4a24-94d6-87005d862ede None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.211906 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f605-b4c4-4a24-94d6-87005d862ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.212658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99f605-b4c4-4a24-94d6-87005d862ede None admin] RBAC: Adding query filter params (role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=001c65d7373e4b1eb3b0abc263e553f7) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:18.212972 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99f605-b4c4-4a24-94d6-87005d862ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:18.216102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99f605-b4c4-4a24-94d6-87005d862ede None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:18.233256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 128/267] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:17 2022] GET /identity/v3/role_assignments?user.id=001c65d7373e4b1eb3b0abc263e553f7&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:18.284589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c7f4-0e89-4fef-b17d-524e4ad2c48b None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.285274 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c7f4-0e89-4fef-b17d-524e4ad2c48b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.285274 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c7f4-0e89-4fef-b17d-524e4ad2c48b None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.286879 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 129/268] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:18.292963 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f562b1-1515-472c-ae16-b4cb8d9450a7 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.293270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f562b1-1515-472c-ae16-b4cb8d9450a7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.293505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f562b1-1515-472c-ae16-b4cb8d9450a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.336418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-05f562b1-1515-472c-ae16-b4cb8d9450a7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:18.337619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-05f562b1-1515-472c-ae16-b4cb8d9450a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:18.358502 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c41dd-96f9-4423-b89d-87b29c4cc0b5 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:18.399810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:18.400845 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.401313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.401765 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.404042 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:18.405927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:18.407899 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 140/269] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:18 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:18.416159 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:18.433698 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:18.472941 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 130/270] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:18.560275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32c54-6399-4d66-96a3-eb24493026bb None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:18.596549 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8db0c8-0f58-4d8f-9f1b-58b55d2d2dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:18.597303 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8db0c8-0f58-4d8f-9f1b-58b55d2d2dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.597585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8db0c8-0f58-4d8f-9f1b-58b55d2d2dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.597847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8db0c8-0f58-4d8f-9f1b-58b55d2d2dc8 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/3f1aa05c1bd5454eaab37be0d864260a/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.599751 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8db0c8-0f58-4d8f-9f1b-58b55d2d2dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2310cdb9aaee4d6bb40f906576dd80ab, user_id=3f1aa05c1bd5454eaab37be0d864260a, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:18.601245 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8db0c8-0f58-4d8f-9f1b-58b55d2d2dc8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:18.617031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 141/271] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:39:18 2022] PUT /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/3f1aa05c1bd5454eaab37be0d864260a/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:18.729347 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d8d12-fe86-4d60-a413-25098b8695cf None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.729644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d8d12-fe86-4d60-a413-25098b8695cf None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.729830 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d8d12-fe86-4d60-a413-25098b8695cf None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.731329 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 131/272] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:18.738257 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d085c-471a-48ba-ba8a-f0f4c15010e0 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:18.738551 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d085c-471a-48ba-ba8a-f0f4c15010e0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:18.738806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d085c-471a-48ba-ba8a-f0f4c15010e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:18.762069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-359d085c-471a-48ba-ba8a-f0f4c15010e0 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:18.763636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-359d085c-471a-48ba-ba8a-f0f4c15010e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:18.835529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:18.844937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 142/273] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:18.861890 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d8d12-fe86-4d60-a413-25098b8695cf None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:18.968686 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d8d12-fe86-4d60-a413-25098b8695cf None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:18.994800 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:19.004031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:19.004715 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.004988 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.005249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.016282 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:19.029721 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:19.030766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:19.031760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 132/274] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:19.037191 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d085c-471a-48ba-ba8a-f0f4c15010e0 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:19.140277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d085c-471a-48ba-ba8a-f0f4c15010e0 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:19.174110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:19.174886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:19.175712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.175989 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.176257 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.176953 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] RBAC: Adding query filter params (name=member) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:19.177253 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:19.178639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:19.187481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 143/275] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:19.193290 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:19.257702 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:19.306371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bcfb8-899e-46aa-8639-03f0b1a232c1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:19.314093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813169a-5804-4016-8792-5b747ff8c254 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:19.350069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:19.350860 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.351271 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.351610 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] PATH_INFO: `/v3/users/da67aa1846b74674807fc7372a12aaf5` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.354135 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:19.355831 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.356317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.356771 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.358075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:19.359676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:19.362562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 133/276] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:19.367705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:19.369432 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] RBAC: Authorizing `identity:get_user(user_id=da67aa1846b74674807fc7372a12aaf5)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:19.372541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:19.374479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 144/277] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:19 2022] GET /identity/v3/users/da67aa1846b74674807fc7372a12aaf5 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:19.380454 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:19.437671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:19.496674 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e021-fa3b-42c0-a385-be788083f3c8 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:19.521806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edda59-6952-4c06-a54d-b9a0ef0b7624 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:19.536701 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e4552-e2b9-426b-a3c2-f325554eb732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:19.537658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e4552-e2b9-426b-a3c2-f325554eb732 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.538144 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e4552-e2b9-426b-a3c2-f325554eb732 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.538606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e4552-e2b9-426b-a3c2-f325554eb732 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.539475 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e4552-e2b9-426b-a3c2-f325554eb732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:19.541181 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e4552-e2b9-426b-a3c2-f325554eb732 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:19.542991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:19.565325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fe534-ce15-4873-a702-0fe08d8c1c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:19.566407 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fe534-ce15-4873-a702-0fe08d8c1c4d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.567103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fe534-ce15-4873-a702-0fe08d8c1c4d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.567588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fe534-ce15-4873-a702-0fe08d8c1c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.572719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 134/278] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:19 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:19.573810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fe534-ce15-4873-a702-0fe08d8c1c4d None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, user.id=da67aa1846b74674807fc7372a12aaf5, scope.system=all) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:19.573810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fe534-ce15-4873-a702-0fe08d8c1c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:19.575104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fe534-ce15-4873-a702-0fe08d8c1c4d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:19.581536 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 145/279] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Aug 22 17:39:19 2022] GET /identity/v3/role_assignments?user.id=da67aa1846b74674807fc7372a12aaf5&scope.system=all&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:19.607975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fe9e-d3c5-41d0-883e-b90c1c9daa06 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.608237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fe9e-d3c5-41d0-883e-b90c1c9daa06 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.608526 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fe9e-d3c5-41d0-883e-b90c1c9daa06 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.610324 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 135/280] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:19.617428 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577eca3-9940-45e9-8a6b-0a801a7322b6 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:19.617760 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577eca3-9940-45e9-8a6b-0a801a7322b6 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:19.617984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577eca3-9940-45e9-8a6b-0a801a7322b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:19.637905 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-0577eca3-9940-45e9-8a6b-0a801a7322b6 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:19.639262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-0577eca3-9940-45e9-8a6b-0a801a7322b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:19.725400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 146/281] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:20.059607 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fe9e-d3c5-41d0-883e-b90c1c9daa06 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:20.189897 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fe9e-d3c5-41d0-883e-b90c1c9daa06 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:20.215400 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:20.239182 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:20.239829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:20.240099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:20.240364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:20.251580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:20.259364 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:20.260393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:20.261405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 136/282] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:20.275371 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577eca3-9940-45e9-8a6b-0a801a7322b6 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:20.395676 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577eca3-9940-45e9-8a6b-0a801a7322b6 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:20.409993 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:20.436025 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:20.436660 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:20.436940 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:20.437209 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:20.437880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] RBAC: Adding query filter params (name=reader) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:20.438178 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:20.439568 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:20.448367 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 147/283] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:20.454259 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:20.597440 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d30c3-abd5-45f8-8af3-777155107bd8 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:20.646894 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:20.647453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:20.647727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:20.647993 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] PATH_INFO: `/v3/users/19bfe40272294b9e8e1de0dbaebb38ec` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:20.649151 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] RBAC: Authorizing `identity:get_user(user_id=19bfe40272294b9e8e1de0dbaebb38ec)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:20.650591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:20.652329 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 137/284] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:20 2022] GET /identity/v3/users/19bfe40272294b9e8e1de0dbaebb38ec => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:20.658280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:20.776744 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae372c-60d8-423c-95e9-a3528795582f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:20.816031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8647b-0649-486b-87b7-8add52e08795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:20.816702 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8647b-0649-486b-87b7-8add52e08795 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:20.816982 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8647b-0649-486b-87b7-8add52e08795 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:20.817252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8647b-0649-486b-87b7-8add52e08795 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:20.818688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8647b-0649-486b-87b7-8add52e08795 None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:20.820159 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8647b-0649-486b-87b7-8add52e08795 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:20.822180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 148/285] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:20 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:20.829669 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:20.897108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:20.977860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961901d-1ec0-4f09-9aac-703e17058ebd None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:21.028585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bbdc4-8c6a-4220-9877-a20cb02873e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:21.029298 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bbdc4-8c6a-4220-9877-a20cb02873e1 None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:21.029739 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bbdc4-8c6a-4220-9877-a20cb02873e1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:21.030225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bbdc4-8c6a-4220-9877-a20cb02873e1 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/19bfe40272294b9e8e1de0dbaebb38ec/roles/b582cb49cc524493b32b0a2dbf57afc5` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:21.033193 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bbdc4-8c6a-4220-9877-a20cb02873e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2310cdb9aaee4d6bb40f906576dd80ab, user_id=19bfe40272294b9e8e1de0dbaebb38ec, role_id=b582cb49cc524493b32b0a2dbf57afc5)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:21.043044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bbdc4-8c6a-4220-9877-a20cb02873e1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:21.057727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 138/286] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:39:20 2022] PUT /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/users/19bfe40272294b9e8e1de0dbaebb38ec/roles/b582cb49cc524493b32b0a2dbf57afc5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:21.112640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2bfdf-9001-4ff6-8557-b927ee1f10c7 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:21.112990 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2bfdf-9001-4ff6-8557-b927ee1f10c7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:21.113210 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2bfdf-9001-4ff6-8557-b927ee1f10c7 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:21.114765 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 149/287] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:21.120209 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6c0e-5213-437b-a6c0-abc859890488 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:21.120507 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6c0e-5213-437b-a6c0-abc859890488 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:21.120813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6c0e-5213-437b-a6c0-abc859890488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:21.146778 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-08ad6c0e-5213-437b-a6c0-abc859890488 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:21.148048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-08ad6c0e-5213-437b-a6c0-abc859890488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:21.243506 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 139/288] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:21.747474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2bfdf-9001-4ff6-8557-b927ee1f10c7 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:21.802940 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:21.886489 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2bfdf-9001-4ff6-8557-b927ee1f10c7 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:21.941495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b018325-3e14-45e8-8ac5-12577bf5233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:21.942146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018325-3e14-45e8-8ac5-12577bf5233f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:21.942418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018325-3e14-45e8-8ac5-12577bf5233f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:21.943003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018325-3e14-45e8-8ac5-12577bf5233f None admin] PATH_INFO: `/v3/roles/member` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:21.960060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018325-3e14-45e8-8ac5-12577bf5233f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-8b018325-3e14-45e8-8ac5-12577bf5233f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:21.965978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:21.966971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:21.967773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 150/289] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:21.972984 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6c0e-5213-437b-a6c0-abc859890488 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:22.001971 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:22.112250 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6c0e-5213-437b-a6c0-abc859890488 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:22.155427 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:22.156061 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.156335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.156604 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.157361 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:22.157658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:22.159040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:22.164959 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8078f-0f84-4fcd-8f8a-1dac14b661f5 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.165230 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8078f-0f84-4fcd-8f8a-1dac14b661f5 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.165495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8078f-0f84-4fcd-8f8a-1dac14b661f5 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.166978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 151/290] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:22.172914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3047-4723-4f03-9e8f-e0662b39bb8b None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.173210 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3047-4723-4f03-9e8f-e0662b39bb8b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.173483 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3047-4723-4f03-9e8f-e0662b39bb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.176319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 140/291] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:22.181751 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:22.210851 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-ad6e3047-4723-4f03-9e8f-e0662b39bb8b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:22.212065 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-ad6e3047-4723-4f03-9e8f-e0662b39bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:22.305886 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:22.308731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 152/292] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:22.310677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84552c43-c590-4b18-ac1d-b387aa5c1eed None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:22.311728 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e712c-2857-4f02-9c6b-8b69d3974c41 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.312019 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e712c-2857-4f02-9c6b-8b69d3974c41 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.312299 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e712c-2857-4f02-9c6b-8b69d3974c41 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.318010 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 153/293] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:22.319493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adeb3-411d-4a9c-8b33-b035ed7a4483 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.320096 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adeb3-411d-4a9c-8b33-b035ed7a4483 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.320096 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adeb3-411d-4a9c-8b33-b035ed7a4483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.357030 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:22.358047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.358568 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.359016 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] PATH_INFO: `/v3/users/3f1aa05c1bd5454eaab37be0d864260a` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.360723 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c43adeb3-411d-4a9c-8b33-b035ed7a4483 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:22.362189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c43adeb3-411d-4a9c-8b33-b035ed7a4483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:22.362757 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] RBAC: Authorizing `identity:get_user(user_id=3f1aa05c1bd5454eaab37be0d864260a)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:22.364342 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:22.366691 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 141/294] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:22 2022] GET /identity/v3/users/3f1aa05c1bd5454eaab37be0d864260a => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:22.372262 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:22.393110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:22.463771 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 154/295] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:22.532356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701a33a-7002-4227-a4ab-828a2e6059c6 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:22.573956 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:22.574708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.574991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.575266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.611432 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:22.670064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:22.671578 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:22.741637 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7dfb-0e98-4540-b830-b52013c0a9b2 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.741958 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7dfb-0e98-4540-b830-b52013c0a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.742181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7dfb-0e98-4540-b830-b52013c0a9b2 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.743527 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 155/296] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:22.748591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db201-3253-41bb-93b1-a517474e8a0b None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:22.749155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db201-3253-41bb-93b1-a517474e8a0b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:22.749155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db201-3253-41bb-93b1-a517474e8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:22.768526 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-b26db201-3253-41bb-93b1-a517474e8a0b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:22.769787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-b26db201-3253-41bb-93b1-a517474e8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:22.794864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 142/297] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 17:39:22.795665 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:22.848291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 156/298] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:22.849200 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db201-3253-41bb-93b1-a517474e8a0b None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:22.880452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:22.950888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f105c5-fd3a-4984-a74b-4271d4533af5 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:22.951923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:22.963124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db201-3253-41bb-93b1-a517474e8a0b None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.000838 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.001695 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.001849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.002063 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.013507 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.013796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:23.014529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.014943 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.015356 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.016672 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.018249 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:23.018742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:23.019764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 143/299] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:23.020672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.038511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 157/300] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:22 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:23.038511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.194712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125db80-e55a-4ab3-b57c-2afde14fdab4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.213999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed7493-37e6-4ef2-bae6-7b559ee357a4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.215157 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:23.236297 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.237604 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.238076 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.238631 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.252261 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:23.257939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:23.258195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:23.259023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:23.259812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:23.260409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.260409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.260409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.260409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=3f1aa05c1bd5454eaab37be0d864260a) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:23.260409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.264319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.264453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 144/301] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:23.264453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.271992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 158/302] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/role_assignments?user.id=3f1aa05c1bd5454eaab37be0d864260a&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:23.277913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.313775 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:23.405813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1428a75-1b48-4339-bab0-d18ed73bc894 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.418871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeac7d-a9d9-44cd-9037-929739eb8e90 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.454024 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.455076 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.455826 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.456532 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.457372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:23.457982 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.460096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.464010 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.464801 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.465204 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.465537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.467499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.470003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.471674 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 145/303] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:23.472670 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.476806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 159/304] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:23.478368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.520121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:23.584987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:23.595150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1a48c-c05c-48ea-891f-ff24ca8a2500 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.598051 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af5ec7-eaaa-462e-b944-8f391677ecc9 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.630705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.631339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.631612 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.631878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] PATH_INFO: `/v3/groups` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.632493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.633546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.634013 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.634198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.634455 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.634726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.635395 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] RBAC: Adding query filter params (name=reader) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:23.635694 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.637181 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.648757 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 146/305] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:23.649911 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.650034 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 160/306] 10.222.0.59 () {60 vars in 1134 bytes} [Mon Aug 22 17:39:23 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:23.655537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.773798 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068e60a-d477-46e1-9dc0-cccc545c9d6d None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.792590 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234ef7a-178a-4eae-988f-513805e0f24a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.795103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:23.821610 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.822712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.823245 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.823742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] PATH_INFO: `/v3/users/f2808b920f6c456688ee0fa779f7851f` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.840659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] RBAC: Authorizing `identity:get_user(user_id=f2808b920f6c456688ee0fa779f7851f)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.842716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.845991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:23.846125 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 161/307] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/users/f2808b920f6c456688ee0fa779f7851f => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:23.846198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:23.846385 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:23.846612 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] PATH_INFO: `/v3/users/da67aa1846b74674807fc7372a12aaf5` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:23.847894 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] RBAC: Authorizing `identity:get_user(user_id=da67aa1846b74674807fc7372a12aaf5)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:23.850081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:23.850977 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 147/308] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/users/da67aa1846b74674807fc7372a12aaf5 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:23.852549 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.857042 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:23.869124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:23.976210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0456a-e52c-4937-86ca-385f6d54dfe3 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:23.990449 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75920cb7-e6c4-4caa-928a-ebebbc3d807b None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:24.015431 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b46c26-c8c2-448a-937e-3448d0583d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:24.016799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46c26-c8c2-448a-937e-3448d0583d8a None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:24.017212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46c26-c8c2-448a-937e-3448d0583d8a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:24.017615 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46c26-c8c2-448a-937e-3448d0583d8a None admin] PATH_INFO: `/v3/system/users/da67aa1846b74674807fc7372a12aaf5/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:24.019365 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b46c26-c8c2-448a-937e-3448d0583d8a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da67aa1846b74674807fc7372a12aaf5, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:24.020775 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b46c26-c8c2-448a-937e-3448d0583d8a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:24.030518 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 148/309] 10.222.0.59 () {58 vars in 1334 bytes} [Mon Aug 22 17:39:23 2022] PUT /identity/v3/system/users/da67aa1846b74674807fc7372a12aaf5/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:24.030748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85799-c954-4c94-a8b3-8514bc7ba531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:24.031450 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85799-c954-4c94-a8b3-8514bc7ba531 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:24.031731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85799-c954-4c94-a8b3-8514bc7ba531 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:24.032005 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85799-c954-4c94-a8b3-8514bc7ba531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:24.032846 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad85799-c954-4c94-a8b3-8514bc7ba531 None admin] RBAC: Adding query filter params (role.id=b582cb49cc524493b32b0a2dbf57afc5, user.id=f2808b920f6c456688ee0fa779f7851f, scope.system=all) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:24.033184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad85799-c954-4c94-a8b3-8514bc7ba531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:24.034847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad85799-c954-4c94-a8b3-8514bc7ba531 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:24.041300 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 162/310] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Aug 22 17:39:23 2022] GET /identity/v3/role_assignments?user.id=f2808b920f6c456688ee0fa779f7851f&scope.system=all&role.id=b582cb49cc524493b32b0a2dbf57afc5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:24.042303 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef55c4-63c7-42a0-abcb-a9d2059dd023 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:24.042606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef55c4-63c7-42a0-abcb-a9d2059dd023 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:24.042881 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef55c4-63c7-42a0-abcb-a9d2059dd023 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:24.044463 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 149/311] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:24.056999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b822-9ead-4298-98e0-24d0d5b6c2c3 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:24.056999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b822-9ead-4298-98e0-24d0d5b6c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:24.056999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b822-9ead-4298-98e0-24d0d5b6c2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:24.077069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-1430b822-9ead-4298-98e0-24d0d5b6c2c3 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:24.078363 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-1430b822-9ead-4298-98e0-24d0d5b6c2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:24.162229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 163/312] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:24.505097 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef55c4-63c7-42a0-abcb-a9d2059dd023 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:24.543502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:24.621070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef55c4-63c7-42a0-abcb-a9d2059dd023 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:24.656476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:24.657135 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:24.657408 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:24.657675 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:24.668171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:24.673447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:24.674333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:24.675158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 150/313] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:24.682450 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430b822-9ead-4298-98e0-24d0d5b6c2c3 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:24.687443 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:24.793060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430b822-9ead-4298-98e0-24d0d5b6c2c3 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:24.829390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:24.830444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:24.830942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:24.831403 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:24.832281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] RBAC: Adding query filter params (name=reader) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:24.832809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:24.834431 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:24.848843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 164/314] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:24.853700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:24.951552 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:24.958649 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cec9b-d379-49b2-b1a0-96b0ae180554 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:24.992927 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:24.993603 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:24.993882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:24.994152 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] PATH_INFO: `/v3/users/19bfe40272294b9e8e1de0dbaebb38ec` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:24.995333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] RBAC: Authorizing `identity:get_user(user_id=19bfe40272294b9e8e1de0dbaebb38ec)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:24.997077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:24.999417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 151/315] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:24 2022] GET /identity/v3/users/19bfe40272294b9e8e1de0dbaebb38ec => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:25.004935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:25.114704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:25.154896 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdcb9b-6db4-4882-bc44-fb54811fd43a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:25.193056 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:25.193685 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:25.194737 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:25.194737 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:25.271025 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:25.272509 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:25.342241 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:25.381768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 165/316] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:25.387529 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:25.490168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a576b9-961f-4017-b68b-1822d2fc54e3 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:25.524309 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393e07-bc86-40ba-8e5f-5ba3ced7df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:25.525188 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393e07-bc86-40ba-8e5f-5ba3ced7df78 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:25.525560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393e07-bc86-40ba-8e5f-5ba3ced7df78 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:25.526000 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393e07-bc86-40ba-8e5f-5ba3ced7df78 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:25.527249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393e07-bc86-40ba-8e5f-5ba3ced7df78 None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:25.528853 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393e07-bc86-40ba-8e5f-5ba3ced7df78 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:25.530587 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 152/317] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:25 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:25.536727 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:25.643640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249329e6-f1da-4d4e-8947-f5ea5f23850c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:25.680645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d0246-2d67-4d78-a90a-524fb0a7fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:25.681332 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0246-2d67-4d78-a90a-524fb0a7fab7 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:25.681604 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0246-2d67-4d78-a90a-524fb0a7fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:25.681868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0246-2d67-4d78-a90a-524fb0a7fab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:25.682589 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d0246-2d67-4d78-a90a-524fb0a7fab7 None admin] RBAC: Adding query filter params (role.id=b582cb49cc524493b32b0a2dbf57afc5, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab, user.id=19bfe40272294b9e8e1de0dbaebb38ec) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:25.682888 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d0246-2d67-4d78-a90a-524fb0a7fab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:25.684380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d0246-2d67-4d78-a90a-524fb0a7fab7 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:25.691181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 166/318] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:25 2022] GET /identity/v3/role_assignments?user.id=19bfe40272294b9e8e1de0dbaebb38ec&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=b582cb49cc524493b32b0a2dbf57afc5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:26.215994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1910-d9c8-4d48-8646-700586480a48 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.216206 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1910-d9c8-4d48-8646-700586480a48 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.216484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1910-d9c8-4d48-8646-700586480a48 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.217999 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 153/319] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:26.223727 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dea86-45e2-435b-8ebb-1d67e045ba18 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.224291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dea86-45e2-435b-8ebb-1d67e045ba18 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.224291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dea86-45e2-435b-8ebb-1d67e045ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.245250 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e11dea86-45e2-435b-8ebb-1d67e045ba18 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:26.246700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e11dea86-45e2-435b-8ebb-1d67e045ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:26.285263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:26.331329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 167/320] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:26.399678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb4b7-0218-42d3-8f8c-13dfaf1df3e2 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.399678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb4b7-0218-42d3-8f8c-13dfaf1df3e2 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.401787 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb4b7-0218-42d3-8f8c-13dfaf1df3e2 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.401787 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 154/321] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:26.409331 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ab255-0634-4ed9-97c0-08d4386a936b None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.409625 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ab255-0634-4ed9-97c0-08d4386a936b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.409895 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ab255-0634-4ed9-97c0-08d4386a936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.417390 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a153-6fac-4a36-8d18-12e20c6cfaca None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.417682 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a153-6fac-4a36-8d18-12e20c6cfaca None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.417946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a153-6fac-4a36-8d18-12e20c6cfaca None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.419323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 155/322] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:26.424640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90adaa9-d11d-4d97-a796-ff6eecf34eb0 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.424933 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90adaa9-d11d-4d97-a796-ff6eecf34eb0 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.425367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90adaa9-d11d-4d97-a796-ff6eecf34eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.429445 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-b75ab255-0634-4ed9-97c0-08d4386a936b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:26.430640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-b75ab255-0634-4ed9-97c0-08d4386a936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:26.445403 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-b90adaa9-d11d-4d97-a796-ff6eecf34eb0 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:26.446609 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b90adaa9-d11d-4d97-a796-ff6eecf34eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:26.471864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:26.509186 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 168/323] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:26.519643 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 156/324] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:26.658052 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ab255-0634-4ed9-97c0-08d4386a936b None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:26.749908 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:26.761133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ab255-0634-4ed9-97c0-08d4386a936b None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:26.795453 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:26.796077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.796351 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.796655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] PATH_INFO: `/v3/domains/default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.797707 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:26.799257 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:26.800847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 169/325] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:26.806419 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90adaa9-d11d-4d97-a796-ff6eecf34eb0 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:26.829872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:26.905922 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90adaa9-d11d-4d97-a796-ff6eecf34eb0 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:26.933247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba79b-bc6c-460d-b6fe-c96710f76917 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:26.938980 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:26.939588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.939866 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.940140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] PATH_INFO: `/v3/groups` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:26.940807 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:26.942586 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:26.959389 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 157/326] 10.222.0.59 () {60 vars in 1134 bytes} [Mon Aug 22 17:39:26 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:26.959389 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:26.985186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:26.991925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:26.992576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:26.992906 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:26.993171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.007329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:27.012525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:27.013553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:27.014405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 170/327] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:27.020887 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:27.045134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:27.106090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956363b1-72b3-4f59-be11-5210e841e88d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:27.144119 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:27.145297 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:27.145580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:27.146008 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.159034 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:27.159294 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb023-2c34-40ac-9b39-7eeda5c717bf None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:27.164207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:27.165225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:27.166222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 158/328] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:27.171520 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:27.210191 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:27.211108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:27.212245 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:27.212245 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.212803 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:27.213200 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:27.214660 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:27.224669 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 171/329] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:27.231219 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:27.267133 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:27.297197 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c2f5d-0c03-4450-9f1d-3b7f88276646 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:27.344825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:27.345447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:27.345726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:27.345997 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.346673 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:27.346975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:27.348954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:27.355701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:27.361192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 159/330] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:27.368235 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:27.378403 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1fa9-6c25-4436-b310-76696ccb7a62 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:27.419362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:27.420303 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:27.420822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:27.421287 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] PATH_INFO: `/v3/users/f2808b920f6c456688ee0fa779f7851f` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.423488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] RBAC: Authorizing `identity:get_user(user_id=f2808b920f6c456688ee0fa779f7851f)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:27.425339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:27.427673 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 172/331] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:27 2022] GET /identity/v3/users/f2808b920f6c456688ee0fa779f7851f => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:27.433181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:27.512743 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174ed81-0b2d-4749-9843-e21b2cebce1b None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:27.554903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce160e4c-34f6-4cfc-9c40-d444eeebcc89 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:27.564097 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:27.564883 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:27.565165 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:27.565518 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] PATH_INFO: `/v3/users/da67aa1846b74674807fc7372a12aaf5` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.567842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] RBAC: Authorizing `identity:get_user(user_id=da67aa1846b74674807fc7372a12aaf5)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:27.570049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:27.574937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 160/332] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:27 2022] GET /identity/v3/users/da67aa1846b74674807fc7372a12aaf5 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:27.581562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:27.604062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:27.614385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecc52f-eceb-41ba-b4b1-d05d7b5789d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:27.615047 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecc52f-eceb-41ba-b4b1-d05d7b5789d6 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:27.615318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecc52f-eceb-41ba-b4b1-d05d7b5789d6 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:27.615586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecc52f-eceb-41ba-b4b1-d05d7b5789d6 None admin] PATH_INFO: `/v3/system/users/f2808b920f6c456688ee0fa779f7851f/roles/b582cb49cc524493b32b0a2dbf57afc5` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.617126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecc52f-eceb-41ba-b4b1-d05d7b5789d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f2808b920f6c456688ee0fa779f7851f, role_id=b582cb49cc524493b32b0a2dbf57afc5)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:27.618501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecc52f-eceb-41ba-b4b1-d05d7b5789d6 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:27.631553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 173/333] 10.222.0.59 () {58 vars in 1334 bytes} [Mon Aug 22 17:39:27 2022] PUT /identity/v3/system/users/f2808b920f6c456688ee0fa779f7851f/roles/b582cb49cc524493b32b0a2dbf57afc5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:27.741702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d4cc5-ddc0-4691-b0cb-3fd8079d0b62 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:27.786299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd67fa-bcc1-4940-8f07-5d452813bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:27.787261 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd67fa-bcc1-4940-8f07-5d452813bc8c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:27.787719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd67fa-bcc1-4940-8f07-5d452813bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:27.788265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd67fa-bcc1-4940-8f07-5d452813bc8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:27.789488 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd67fa-bcc1-4940-8f07-5d452813bc8c None admin] RBAC: Adding query filter params (role.id=503842e4c2704f92b9ed69eb792b3c8c, user.id=da67aa1846b74674807fc7372a12aaf5, scope.system=all) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:27.790089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd67fa-bcc1-4940-8f07-5d452813bc8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:27.792230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd67fa-bcc1-4940-8f07-5d452813bc8c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:27.808024 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 161/334] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Aug 22 17:39:27 2022] GET /identity/v3/role_assignments?user.id=da67aa1846b74674807fc7372a12aaf5&scope.system=all&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:29.709161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6c6c2-9840-43bf-8b59-3851eefb1f07 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:29.709795 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6c6c2-9840-43bf-8b59-3851eefb1f07 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:29.709795 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6c6c2-9840-43bf-8b59-3851eefb1f07 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:29.711322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 174/335] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:29.716596 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e393-b4be-4b08-9bd0-266ae02cf50b None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:29.717140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e393-b4be-4b08-9bd0-266ae02cf50b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:29.717221 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e393-b4be-4b08-9bd0-266ae02cf50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:29.741871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-b452e393-b4be-4b08-9bd0-266ae02cf50b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:29.743103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b452e393-b4be-4b08-9bd0-266ae02cf50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:29.791806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924624-d31f-4317-965f-3f2f4797d068 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:29.792286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924624-d31f-4317-965f-3f2f4797d068 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:29.792764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924624-d31f-4317-965f-3f2f4797d068 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:29.795377 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 175/336] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:29.801958 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27443c8-9b9c-4305-b2f5-9e2e16d8cbda None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:29.802433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27443c8-9b9c-4305-b2f5-9e2e16d8cbda None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:29.802898 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27443c8-9b9c-4305-b2f5-9e2e16d8cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:29.865500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e27443c8-9b9c-4305-b2f5-9e2e16d8cbda None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:29.867387 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e27443c8-9b9c-4305-b2f5-9e2e16d8cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:29.893488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:29.900450 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:29.917669 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 162/337] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:30.027474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 176/338] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:30.566102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452e393-b4be-4b08-9bd0-266ae02cf50b None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:30.626991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27443c8-9b9c-4305-b2f5-9e2e16d8cbda None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:30.757907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452e393-b4be-4b08-9bd0-266ae02cf50b None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:30.818788 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd0220-e11e-4994-a039-d8bc58e8304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:30.818982 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27443c8-9b9c-4305-b2f5-9e2e16d8cbda None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:30.819392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd0220-e11e-4994-a039-d8bc58e8304a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:30.819651 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd0220-e11e-4994-a039-d8bc58e8304a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:30.819883 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd0220-e11e-4994-a039-d8bc58e8304a None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:30.835482 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd0220-e11e-4994-a039-d8bc58e8304a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-d1fd0220-e11e-4994-a039-d8bc58e8304a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:30.840319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:30.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:30.842291 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 163/339] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:30.843003 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec40a1-5bf1-4489-9870-b4521d9eebb1 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:30.843003 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec40a1-5bf1-4489-9870-b4521d9eebb1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:30.843915 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec40a1-5bf1-4489-9870-b4521d9eebb1 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:30.851962 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 164/340] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:30.852674 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec40a1-5bf1-4489-9870-b4521d9eebb1 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:30.923303 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:30.930033 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4116a-d139-4624-b876-aee4ea9713ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:30.930692 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4116a-d139-4624-b876-aee4ea9713ff None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:30.930975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4116a-d139-4624-b876-aee4ea9713ff None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:30.931577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4116a-d139-4624-b876-aee4ea9713ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:30.965924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4116a-d139-4624-b876-aee4ea9713ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-f3e4116a-d139-4624-b876-aee4ea9713ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:30.974734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:30.975679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:30.976478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:30.980954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec40a1-5bf1-4489-9870-b4521d9eebb1 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:30.981400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 177/341] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:30.982440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ffe8b-e2b2-4a97-bcaf-c1997c0cd73f None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:30.982731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ffe8b-e2b2-4a97-bcaf-c1997c0cd73f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:30.983007 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ffe8b-e2b2-4a97-bcaf-c1997c0cd73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.006412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:31.024424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-703ffe8b-e2b2-4a97-bcaf-c1997c0cd73f None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:31.026115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-703ffe8b-e2b2-4a97-bcaf-c1997c0cd73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:31.026271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:31.027066 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:31.027427 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:31.027753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.028514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:31.028921 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:31.030436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:31.039664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 165/342] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:31.040421 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:31.155578 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 178/343] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:31.156631 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ffe8b-e2b2-4a97-bcaf-c1997c0cd73f None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:31.159495 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ef8b-3260-4f07-8db4-ec44b0ad2c5e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:31.180010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:31.196527 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6658b-fec4-4d3a-95ce-335702d1abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:31.197195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6658b-fec4-4d3a-95ce-335702d1abd4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:31.197500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6658b-fec4-4d3a-95ce-335702d1abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:31.197909 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6658b-fec4-4d3a-95ce-335702d1abd4 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.198497 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6658b-fec4-4d3a-95ce-335702d1abd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:31.198800 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6658b-fec4-4d3a-95ce-335702d1abd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:31.200229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6658b-fec4-4d3a-95ce-335702d1abd4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:31.209324 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 166/344] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:31.210908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d739-5ee8-4e66-988f-1ce513ffe03b None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:31.211039 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d739-5ee8-4e66-988f-1ce513ffe03b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:31.211259 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d739-5ee8-4e66-988f-1ce513ffe03b None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.216910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 167/345] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:31.218934 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbbabe-6b4a-4815-9345-fbcdab9d3adb None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:31.219211 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbbabe-6b4a-4815-9345-fbcdab9d3adb None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:31.219484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbbabe-6b4a-4815-9345-fbcdab9d3adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.242684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-7bbbbabe-6b4a-4815-9345-fbcdab9d3adb None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:31.244480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-7bbbbabe-6b4a-4815-9345-fbcdab9d3adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:31.302188 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ffe8b-e2b2-4a97-bcaf-c1997c0cd73f None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:31.359730 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:31.369679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:31.370305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:31.370581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:31.370960 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.371529 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 168/346] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:31.372393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbbabe-6b4a-4815-9345-fbcdab9d3adb None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:31.502287 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:31.503731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:31.559920 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbbabe-6b4a-4815-9345-fbcdab9d3adb None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:31.586415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:31.628474 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:31.629276 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:31.629552 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:31.629817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.710238 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 179/347] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:31.711046 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:31.765091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:31.767805 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:31.775124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:31.912419 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da0df-b2e8-445a-b9ed-98fe8c5a68ca None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:31.937674 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 169/348] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:31.938562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:31.958282 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:31.966123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:31.968025 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:31.968305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:31.968571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:31.983605 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:31.989504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:31.990409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 17:39:31.991221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:31.994017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 180/349] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:31.995155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.076525 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17171-bcae-450d-9e31-821446ce802e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.122164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.122810 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.123702 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.123825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.124015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.126232 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.127882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.131089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 170/350] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:31 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.131712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.139879 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ac022-2aa0-4869-80bd-e3bbdeda9812 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.190750 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.192439 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.192977 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.193674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.210696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:32.217808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:32.218779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:32.219563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:32.222191 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 181/351] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:32.228679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.251923 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.280835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02fce3-3e13-4a4c-bcce-5f9597707b18 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.333459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.334034 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.334311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.334578 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.335826 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.337356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.339676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 171/352] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.340325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.375472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474260a-87f9-4545-a430-3c69a24330ca None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.418330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.418949 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.419223 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.419487 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.420161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] RBAC: Adding query filter params (name=reader) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:32.420439 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.421853 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.430923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 182/353] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.431562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.450170 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.464020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e495e-8c37-4ccf-8bf2-2d1f985359e3 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.508367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210348f-e78f-49ae-8ae1-d56990c0dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.509039 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210348f-e78f-49ae-8ae1-d56990c0dc56 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.509319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210348f-e78f-49ae-8ae1-d56990c0dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.510458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210348f-e78f-49ae-8ae1-d56990c0dc56 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.516924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210348f-e78f-49ae-8ae1-d56990c0dc56 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.518653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210348f-e78f-49ae-8ae1-d56990c0dc56 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.521760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 172/354] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.522616 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523388-6e86-434d-a609-147d99c58f5d None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.522720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523388-6e86-434d-a609-147d99c58f5d None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.524684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523388-6e86-434d-a609-147d99c58f5d None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.528666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 173/355] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:32.529576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523388-6e86-434d-a609-147d99c58f5d None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.547647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.559248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518d45-0efb-4f82-90f1-c561cc473254 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.598243 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392f8be-945c-461d-a29d-159643983282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.598774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392f8be-945c-461d-a29d-159643983282 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.599053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392f8be-945c-461d-a29d-159643983282 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.599319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392f8be-945c-461d-a29d-159643983282 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.602211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392f8be-945c-461d-a29d-159643983282 None admin] RBAC: Adding query filter params (name=member) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:32.602211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392f8be-945c-461d-a29d-159643983282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.602211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392f8be-945c-461d-a29d-159643983282 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.613553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 183/356] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.615186 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b212-07ff-44f0-b80c-1cfd0e94ec2a None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.615472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b212-07ff-44f0-b80c-1cfd0e94ec2a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.615742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b212-07ff-44f0-b80c-1cfd0e94ec2a None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.617211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 184/357] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:32.621246 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9b212-07ff-44f0-b80c-1cfd0e94ec2a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.654299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523388-6e86-434d-a609-147d99c58f5d None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.701888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.702528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.702916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.703184 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.705746 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.708467 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.711551 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 174/358] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.712225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.723176 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.752594 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9b212-07ff-44f0-b80c-1cfd0e94ec2a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.796085 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d67f0-db07-45ce-b264-90a961d438c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.796762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d67f0-db07-45ce-b264-90a961d438c1 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.797042 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d67f0-db07-45ce-b264-90a961d438c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.797312 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d67f0-db07-45ce-b264-90a961d438c1 None admin] PATH_INFO: `/v3/users/f2808b920f6c456688ee0fa779f7851f` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.798464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d67f0-db07-45ce-b264-90a961d438c1 None admin] RBAC: Authorizing `identity:get_user(user_id=f2808b920f6c456688ee0fa779f7851f)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.799909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d67f0-db07-45ce-b264-90a961d438c1 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.801556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 185/359] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/users/f2808b920f6c456688ee0fa779f7851f => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.802703 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8c79-383c-43b1-92dd-bea04ae8bc7e None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.802934 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8c79-383c-43b1-92dd-bea04ae8bc7e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.803205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8c79-383c-43b1-92dd-bea04ae8bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.819690 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.825079 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-408a8c79-383c-43b1-92dd-bea04ae8bc7e None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:32.826290 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-408a8c79-383c-43b1-92dd-bea04ae8bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:32.844937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f25b5-7dcf-4291-a621-da635f1d3b41 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:32.886564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:32.887264 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.887540 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.888362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.888531 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:32.889569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:32.890728 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:32.896881 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 175/360] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:32.898151 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:32.910607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 186/361] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:32.912440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550190-f5d3-4f3e-a101-cdc5f2d90480 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:32.913417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550190-f5d3-4f3e-a101-cdc5f2d90480 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:32.913862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550190-f5d3-4f3e-a101-cdc5f2d90480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:32.942054 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-8a550190-f5d3-4f3e-a101-cdc5f2d90480 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:32.943534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-8a550190-f5d3-4f3e-a101-cdc5f2d90480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:33.035591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2affe-89d7-46f6-a3ef-18a92de6331a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:33.048708 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 187/362] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:33.049912 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550190-f5d3-4f3e-a101-cdc5f2d90480 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:33.057007 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:33.102518 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:33.103185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:33.103459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:33.103726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:33.125174 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:33.204904 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:33.206279 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:33.274380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550190-f5d3-4f3e-a101-cdc5f2d90480 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:33.331055 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 176/363] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:33.332295 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:33.336689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:33.336689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:33.336689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:33.336689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:33.337026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:33.337026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:33.337609 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:33.344057 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 188/364] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 260 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:33.353214 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:33.399353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:33.453759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:33.524812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f1c4-ec0c-4b36-9bf2-b73f04d8d250 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:33.529034 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6426568-f3bd-4da8-8218-284e7ccbe9fe None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:33.569599 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:33.570511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:33.570886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:33.571146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:33.572263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:33.574292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:33.574447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:33.574975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:33.575265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:33.575535 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:33.575950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 189/365] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:33.576261 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] RBAC: Adding query filter params (role.id=b582cb49cc524493b32b0a2dbf57afc5, user.id=f2808b920f6c456688ee0fa779f7851f, scope.system=all) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:33.576593 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:33.577932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:33.578056 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:33.593661 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 177/366] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/role_assignments?user.id=f2808b920f6c456688ee0fa779f7851f&scope.system=all&role.id=b582cb49cc524493b32b0a2dbf57afc5 => generated 510 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:33.594530 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:33.746311 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf66936-35ba-4fce-ad2b-07cf800f0df9 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:33.763220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faab20-9e65-4120-b36e-7eb21ee28629 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:33.781087 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:33.789948 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:33.790588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:33.790863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:33.791130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:33.797020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:33.806953 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:33.812519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:33.813458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:33.814254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 190/367] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:33.815927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:33.834525 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:33.836026 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:33.836504 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:33.837042 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:33.869007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:33.874439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:33.875325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:33.876134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:33.885105 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 178/368] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:33.886212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:33.933866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176dfcc-cedc-4ebb-8962-ca06c5ea33d5 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:33.973008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:33.973643 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:33.973917 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:33.974183 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:33.975291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:33.976829 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:33.978445 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 191/369] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:33.979286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:34.005220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe4574-10de-4f6f-ae81-4120901346eb None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:34.052187 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:34.052895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:34.053176 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:34.053636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:34.053740 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:34.054668 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:34.054971 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:34.056367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:34.070991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 179/370] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:34.072350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:34.108977 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:34.109297 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58eb28-5688-4497-a61e-8387328f6256 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:34.167311 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:34.168812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:34.169535 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:34.170001 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:34.171811 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:34.172517 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:34.178768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:34.192000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 192/371] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:34.193463 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:34.226567 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252ab7-55cc-437b-8283-ac96e562388c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:34.281619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:34.282469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:34.282879 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:34.283316 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:34.284232 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:34.285695 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:34.287283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:34.295196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 180/372] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:34 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:34.296516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:34.325565 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a524ec-e7f0-4b68-a43d-5d71e20dc3b9 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:34.354868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:34.366126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:34.366953 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:34.367251 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:34.367610 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:34.404487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:34.419592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8c523-5cc9-4780-b407-2ff29d9c0fe8 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:34.444130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:34.445787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:34.469434 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:34.470333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:34.470776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:34.471200 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:34.589732 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:34.591306 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:34.599994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 193/373] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:34.606383 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:34.639444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:34.728508 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92687d26-27ea-4502-9051-2dd9b032d42b None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:34.772285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:34.773302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:34.773793 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:34.774261 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:34.775600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:34.777991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:34.780165 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 194/374] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:34 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:34.781380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:34.787527 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:34.800886 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 181/375] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:34.813944 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:34.899947 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:34.906904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79866ebb-dd04-4e75-bc6a-737116ac7e3a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:34.947141 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:34.948470 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:34.949105 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:34.949654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:34.950971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:34.952774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:34.955272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 195/376] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:34 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:34.960642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:35.073556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cfb70-8b26-4545-8386-dc8fd30b1568 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:35.097626 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cb630-e2d3-440d-a4b0-a2e063742f4a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:35.114975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:35.115829 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:35.116270 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:35.116781 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:35.118115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:35.118561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:35.120764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:35.127667 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 196/377] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:34 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:35.172398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:35.173427 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:35.173701 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:35.173967 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] PATH_INFO: `/v3/projects/8a065a84a79f4e27982ec8e2b3054801` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:35.177252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] RBAC: Authorizing `identity:get_project(project_id=8a065a84a79f4e27982ec8e2b3054801)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:35.178737 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:35.180804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 182/378] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:34 2022] GET /identity/v3/projects/8a065a84a79f4e27982ec8e2b3054801 => generated 344 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:35.186660 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:35.242609 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:35.364974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4753c-bd68-49c0-99de-3cb8eaf92a1e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:35.411573 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4448b10-d38b-4ba2-97f6-78f51f45e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:35.412213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448b10-d38b-4ba2-97f6-78f51f45e563 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:35.412490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448b10-d38b-4ba2-97f6-78f51f45e563 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:35.412791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448b10-d38b-4ba2-97f6-78f51f45e563 None admin] PATH_INFO: `/v3/groups/50733fbc497b488bbfba28c22415c2a1` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:35.423648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4448b10-d38b-4ba2-97f6-78f51f45e563 None admin] RBAC: Authorizing `identity:get_group(group_id=50733fbc497b488bbfba28c22415c2a1)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:35.425075 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4448b10-d38b-4ba2-97f6-78f51f45e563 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:35.426785 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 197/379] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:35 2022] GET /identity/v3/groups/50733fbc497b488bbfba28c22415c2a1 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:35.433323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:35.517257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:35.567185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5e29-a4fa-4a0d-93c5-b508f009af86 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:35.609929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cccca9-34f3-4e1f-ab02-4cd868399bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:35.610544 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cccca9-34f3-4e1f-ab02-4cd868399bcd None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:35.610818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cccca9-34f3-4e1f-ab02-4cd868399bcd None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:35.611086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cccca9-34f3-4e1f-ab02-4cd868399bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:35.611818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cccca9-34f3-4e1f-ab02-4cd868399bcd None admin] RBAC: Adding query filter params (group.id=50733fbc497b488bbfba28c22415c2a1, role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=8a065a84a79f4e27982ec8e2b3054801) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:35.612119 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cccca9-34f3-4e1f-ab02-4cd868399bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:35.613587 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cccca9-34f3-4e1f-ab02-4cd868399bcd None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:35.627023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 183/380] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:35 2022] GET /identity/v3/role_assignments?group.id=50733fbc497b488bbfba28c22415c2a1&scope.project.id=8a065a84a79f4e27982ec8e2b3054801&role.id=1122faa21ccf460d936f2efb595661ff => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:35.681154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90154b8d-d537-4619-ab54-07f2d29e003e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:35.681766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90154b8d-d537-4619-ab54-07f2d29e003e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:35.682230 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90154b8d-d537-4619-ab54-07f2d29e003e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:35.684172 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 198/381] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:35.690142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432967c-a227-4007-b0e8-023592a2a3d7 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:35.690758 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432967c-a227-4007-b0e8-023592a2a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:35.691256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432967c-a227-4007-b0e8-023592a2a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:35.713700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-3432967c-a227-4007-b0e8-023592a2a3d7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:35.715339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-3432967c-a227-4007-b0e8-023592a2a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:35.812201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 184/382] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:36.215216 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fa307-3551-4fbf-a053-22c88883d282 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:36.215762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fa307-3551-4fbf-a053-22c88883d282 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:36.215762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fa307-3551-4fbf-a053-22c88883d282 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:36.217358 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 199/383] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:36.223074 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38310a41-126e-40a1-94c4-7bb4bf76bffe None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:36.223493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38310a41-126e-40a1-94c4-7bb4bf76bffe None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:36.223696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38310a41-126e-40a1-94c4-7bb4bf76bffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:36.249723 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-38310a41-126e-40a1-94c4-7bb4bf76bffe None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:36.250933 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-38310a41-126e-40a1-94c4-7bb4bf76bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:36.313000 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:36.342482 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 185/384] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:36.455451 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fa307-3551-4fbf-a053-22c88883d282 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:36.585392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:36.590433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fa307-3551-4fbf-a053-22c88883d282 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:36.634226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:36.634881 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:36.635160 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:36.635432 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:36.661635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:36.666388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:36.667322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:36.668198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 200/385] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:36.673734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38310a41-126e-40a1-94c4-7bb4bf76bffe None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:36.785269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38310a41-126e-40a1-94c4-7bb4bf76bffe None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:36.832398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:36.833050 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:36.833329 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:36.833599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:36.834270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:36.834569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:36.835994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:36.844740 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 186/386] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:36.850226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:36.979561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d2140-097a-4a7c-b892-d173b60452cd None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:37.009106 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:37.041690 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:37.042372 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.042652 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.042973 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.047348 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:37.048858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:37.056933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 201/387] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:36 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:37.066059 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:37.087358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:37.157074 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:37.212324 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e61f23-9a85-4a63-9d2f-f1a880960e85 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:37.252943 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:37.253606 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.253860 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.254142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.255486 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:37.256955 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:37.259433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 202/388] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:37 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:37.267410 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:37.285391 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0186-e625-44f7-a4e9-53557cfbb65c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:37.364411 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b65a-8087-4480-8ff5-541d356af5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:37.365016 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b65a-8087-4480-8ff5-541d356af5c4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.365297 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b65a-8087-4480-8ff5-541d356af5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.365571 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b65a-8087-4480-8ff5-541d356af5c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.377244 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3b65a-8087-4480-8ff5-541d356af5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:37.379882 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-c5e3b65a-8087-4480-8ff5-541d356af5c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:37.384113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:37.385082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:37.386175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:37.390894 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 187/389] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:37.393204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e669f-6b95-49d6-b2e9-58535e97b329 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.393491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e669f-6b95-49d6-b2e9-58535e97b329 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.393767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e669f-6b95-49d6-b2e9-58535e97b329 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.395053 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 188/390] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:37.395748 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e669f-6b95-49d6-b2e9-58535e97b329 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:37.395915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33f10d-1673-467b-a3e7-de92d06e7051 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:37.435521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f56ed-2c08-4e6c-90b4-c6a751feba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:37.436488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f56ed-2c08-4e6c-90b4-c6a751feba10 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.436987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f56ed-2c08-4e6c-90b4-c6a751feba10 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.437774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f56ed-2c08-4e6c-90b4-c6a751feba10 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.441259 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f56ed-2c08-4e6c-90b4-c6a751feba10 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c774aab3a3f410cbe5fda133641dc5c, group_id=ec6a40ef174c4bed9b91c8e4e561c4c2, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:37.444171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f56ed-2c08-4e6c-90b4-c6a751feba10 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:37.462615 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 203/391] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Aug 22 17:39:37 2022] PUT /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:37.464213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebabf-4e35-4af5-947d-736fd0e89abc None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.464591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebabf-4e35-4af5-947d-736fd0e89abc None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.464950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebabf-4e35-4af5-947d-736fd0e89abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.503241 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-497ebabf-4e35-4af5-947d-736fd0e89abc None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:37.508805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-497ebabf-4e35-4af5-947d-736fd0e89abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:37.550355 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e669f-6b95-49d6-b2e9-58535e97b329 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:37.553332 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:37.595087 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:37.595708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.595980 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.596248 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.597219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:37.597519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:37.598907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:37.612907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 189/392] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:37.621004 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:37.683522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 204/393] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:37.786794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5317f73-ccf2-48e2-89ab-30a80d6763cc None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:37.827345 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d363721-3d52-4bcb-b40e-9a5614b260c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:37.828114 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d363721-3d52-4bcb-b40e-9a5614b260c1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.828429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d363721-3d52-4bcb-b40e-9a5614b260c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.828745 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d363721-3d52-4bcb-b40e-9a5614b260c1 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.829872 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d363721-3d52-4bcb-b40e-9a5614b260c1 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:37.831318 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d363721-3d52-4bcb-b40e-9a5614b260c1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:37.833104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 190/394] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:37 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:37.839751 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ebabf-4e35-4af5-947d-736fd0e89abc None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:37.923444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:37.932148 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5a4f8-158e-46fb-8c53-660cef1f30bb None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.932559 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5a4f8-158e-46fb-8c53-660cef1f30bb None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.933110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5a4f8-158e-46fb-8c53-660cef1f30bb None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.935524 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 191/395] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:37.947462 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0a84-4263-4886-ac42-2b9ead5f8497 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:37.947772 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0a84-4263-4886-ac42-2b9ead5f8497 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:37.947996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0a84-4263-4886-ac42-2b9ead5f8497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:37.969959 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-e3fc0a84-4263-4886-ac42-2b9ead5f8497 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:37.971856 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-e3fc0a84-4263-4886-ac42-2b9ead5f8497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:37.979523 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ebabf-4e35-4af5-947d-736fd0e89abc None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:38.005953 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:38.073379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:38.074321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.074599 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.074866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.076331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 192/396] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:38.078027 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:38.079492 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:38.081342 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 205/397] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:37 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:38.087186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0a84-4263-4886-ac42-2b9ead5f8497 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:38.152435 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:38.213796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0a84-4263-4886-ac42-2b9ead5f8497 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:38.259050 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:38.259829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.260113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.260388 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/c31d5cb4bf2d4d89863537cb77b66262` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.270794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c774aab3a3f410cbe5fda133641dc5c, group_id=ec6a40ef174c4bed9b91c8e4e561c4c2, role_id=c31d5cb4bf2d4d89863537cb77b66262)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:38.272558 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:38.288591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 193/398] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Aug 22 17:39:38 2022] PUT /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/c31d5cb4bf2d4d89863537cb77b66262 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:38.306127 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dc649-c4ad-45f2-b45f-d782b38b4428 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:38.374508 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:38.375176 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.375452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.375708 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.399213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:38.406434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:38.407380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:38.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 206/399] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:38.410595 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:38.425916 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:38.431210 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:38.469263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:38.567151 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36156-a8b6-4055-8a87-7a7878202e76 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:38.597973 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af04a81-69fa-4545-8f9a-260f803a7019 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:38.606849 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50e47-d9f5-42ff-9f46-d8448ee46b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:38.607519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50e47-d9f5-42ff-9f46-d8448ee46b62 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.607803 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50e47-d9f5-42ff-9f46-d8448ee46b62 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.608053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50e47-d9f5-42ff-9f46-d8448ee46b62 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.608862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50e47-d9f5-42ff-9f46-d8448ee46b62 None admin] RBAC: Adding query filter params (name=member) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:38.609158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50e47-d9f5-42ff-9f46-d8448ee46b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:38.610602 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50e47-d9f5-42ff-9f46-d8448ee46b62 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:38.619838 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 207/400] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:38.621375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0260-f3ed-4b42-ba17-888118df6539 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.621653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0260-f3ed-4b42-ba17-888118df6539 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.621923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0260-f3ed-4b42-ba17-888118df6539 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.623272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 208/401] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:38.627874 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0260-f3ed-4b42-ba17-888118df6539 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:38.648228 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef10beb-00aa-4ab3-88cb-bca805949445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:38.649471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef10beb-00aa-4ab3-88cb-bca805949445 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.649940 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef10beb-00aa-4ab3-88cb-bca805949445 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.650376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef10beb-00aa-4ab3-88cb-bca805949445 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.663888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef10beb-00aa-4ab3-88cb-bca805949445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-6ef10beb-00aa-4ab3-88cb-bca805949445 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:38.670305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:38.671289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:38.672080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 194/402] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:38.681522 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a871f10-fda5-424e-89ba-7668c43bfce1 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.681861 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a871f10-fda5-424e-89ba-7668c43bfce1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.682140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a871f10-fda5-424e-89ba-7668c43bfce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.705726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-8a871f10-fda5-424e-89ba-7668c43bfce1 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:38.707189 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-8a871f10-fda5-424e-89ba-7668c43bfce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:38.721243 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:38.767683 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0260-f3ed-4b42-ba17-888118df6539 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:38.800299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 195/403] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:38.800299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a871f10-fda5-424e-89ba-7668c43bfce1 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:38.814796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:38.822616 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:38.823742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:38.824321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:38.825035 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:38.829335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:38.831700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:38.834914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 209/404] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:38 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:38.839837 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:38.963598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a871f10-fda5-424e-89ba-7668c43bfce1 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.022365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cc9d0-d94f-44c3-9a92-fbde3f310fd1 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.061561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.062510 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.063462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.063910 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.065870 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:39.068638 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:39.071356 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 210/405] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:38 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:39.077654 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.078727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.079150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:39.079252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.079673 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.080949 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:39.081492 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:39.083361 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:39.086011 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:39.094045 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 196/406] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:39.099806 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:39.265928 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:39.290717 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49641f-a3ef-46f1-9592-7ea05afd50a1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.314802 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbddab0-f3df-47b2-a4bd-24f463932b35 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.335210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.336273 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.336779 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.337232 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.339063 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:39.340582 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:39.342154 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 197/407] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:39 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:39.347538 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:39.372397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.373528 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.374106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.374833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.378108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] RBAC: Authorizing `identity:create_grant(project_id=2310cdb9aaee4d6bb40f906576dd80ab, group_id=ec6a40ef174c4bed9b91c8e4e561c4c2, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:39.381112 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:39.403276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 211/408] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Aug 22 17:39:39 2022] PUT /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:39.410744 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:39.488886 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cfd82-dbaf-42a4-b858-8d42045f180f None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.521661 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:39.564879 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.565964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.566807 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.567221 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.604351 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:39.617873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:39.619692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:39.621269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:39.625118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 198/409] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:39.630257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:39.637029 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:39.651725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b43dc-2f28-4f6c-af40-cd573a25d48e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.758141 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.759699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.761341 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.762198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.765545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:39.767659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:39.776676 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 212/410] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:39 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:39.776676 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:39.892092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d05a8b-34aa-4542-bda2-58e246fd52e2 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.912810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb6aa-146d-4051-8564-7425798cf60f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:39.947566 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:39.954544 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.955164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.955440 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.955709 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.956380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:39.956705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:39.957255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:39.958067 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:39.958402 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:39.958863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:39.959416 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/c31d5cb4bf2d4d89863537cb77b66262` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:39.961914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] RBAC: Authorizing `identity:create_grant(project_id=2310cdb9aaee4d6bb40f906576dd80ab, group_id=ec6a40ef174c4bed9b91c8e4e561c4c2, role_id=c31d5cb4bf2d4d89863537cb77b66262)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:39.963725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:39.980059 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 199/411] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:39.983980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 213/412] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Aug 22 17:39:39 2022] PUT /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab/groups/ec6a40ef174c4bed9b91c8e4e561c4c2/roles/c31d5cb4bf2d4d89863537cb77b66262 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:39.989800 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:40.077223 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:40.128261 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4e32-8960-48e5-9649-107d91604f11 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:40.182128 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cb836-59b8-4b17-a44a-04afd2b40032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:40.182832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cb836-59b8-4b17-a44a-04afd2b40032 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:40.183140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cb836-59b8-4b17-a44a-04afd2b40032 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:40.183781 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cb836-59b8-4b17-a44a-04afd2b40032 None admin] PATH_INFO: `/v3/groups/50733fbc497b488bbfba28c22415c2a1` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:40.186575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cb836-59b8-4b17-a44a-04afd2b40032 None admin] RBAC: Authorizing `identity:get_group(group_id=50733fbc497b488bbfba28c22415c2a1)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:40.188138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cb836-59b8-4b17-a44a-04afd2b40032 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:40.190283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 200/413] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:39 2022] GET /identity/v3/groups/50733fbc497b488bbfba28c22415c2a1 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:40.196050 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:40.368030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45903e0f-7b88-47cb-8c67-5a9e64b86523 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:40.385350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01912-536c-490f-8055-9425562c1780 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:40.386396 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01912-536c-490f-8055-9425562c1780 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:40.387064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01912-536c-490f-8055-9425562c1780 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:40.389071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 201/414] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:40.395216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81585c7-d9aa-4077-9b73-70b817418059 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:40.395741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81585c7-d9aa-4077-9b73-70b817418059 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:40.396276 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81585c7-d9aa-4077-9b73-70b817418059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:40.404525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:40.405364 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:40.405642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:40.405909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] PATH_INFO: `/v3/projects/8a065a84a79f4e27982ec8e2b3054801` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:40.407026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] RBAC: Authorizing `identity:get_project(project_id=8a065a84a79f4e27982ec8e2b3054801)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:40.408535 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:40.410571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 214/415] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:40 2022] GET /identity/v3/projects/8a065a84a79f4e27982ec8e2b3054801 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:40.421097 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:40.426629 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-c81585c7-d9aa-4077-9b73-70b817418059 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:40.427834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-c81585c7-d9aa-4077-9b73-70b817418059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:40.533648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:40.541322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 202/416] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:40.594282 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a3646-f3f0-49b1-8692-7a9a43dca513 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:40.646193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a558d-63e0-45ab-91fa-391fd77f9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:40.647234 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a558d-63e0-45ab-91fa-391fd77f9d1b None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:40.647711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a558d-63e0-45ab-91fa-391fd77f9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:40.648173 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a558d-63e0-45ab-91fa-391fd77f9d1b None admin] PATH_INFO: `/v3/projects/8a065a84a79f4e27982ec8e2b3054801/groups/50733fbc497b488bbfba28c22415c2a1/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:40.650355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a558d-63e0-45ab-91fa-391fd77f9d1b None admin] RBAC: Authorizing `identity:create_grant(project_id=8a065a84a79f4e27982ec8e2b3054801, group_id=50733fbc497b488bbfba28c22415c2a1, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:40.652336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a558d-63e0-45ab-91fa-391fd77f9d1b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:40.672255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 215/417] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Aug 22 17:39:40 2022] PUT /identity/v3/projects/8a065a84a79f4e27982ec8e2b3054801/groups/50733fbc497b488bbfba28c22415c2a1/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:39:40.977781 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81585c7-d9aa-4077-9b73-70b817418059 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:41.028108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617210-0b46-45c2-952a-5fa1ea02b9d6 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:41.028449 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617210-0b46-45c2-952a-5fa1ea02b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:41.028691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617210-0b46-45c2-952a-5fa1ea02b9d6 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:41.030186 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 216/418] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:41.035395 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66edc08-b5b5-4e3e-883d-948abde369e4 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:41.035678 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66edc08-b5b5-4e3e-883d-948abde369e4 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:41.035956 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66edc08-b5b5-4e3e-883d-948abde369e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:41.051066 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:41.077698 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-d66edc08-b5b5-4e3e-883d-948abde369e4 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:41.078926 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-d66edc08-b5b5-4e3e-883d-948abde369e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:41.098594 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81585c7-d9aa-4077-9b73-70b817418059 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:41.148401 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:41.149070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:41.149350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:41.149621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:41.182429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:41.188044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:41.188965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:41.189842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:41.193881 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 203/419] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:41.202995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 217/420] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:39:41.205994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:41.328443 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e0051-ea12-40d6-b4a8-f0fd3f9b78fb None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:41.352221 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:41.371993 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:41.372635 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:41.372912 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:41.373179 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:41.373854 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:41.374147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:41.375530 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:41.384684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 204/421] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:41.390154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66edc08-b5b5-4e3e-883d-948abde369e4 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:41.491153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:41.568984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66edc08-b5b5-4e3e-883d-948abde369e4 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:41.617451 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:41.618082 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:41.618367 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:41.618635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:41.716135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:41.717640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:41.784195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:41.845799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:41.854224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 218/422] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:41.860092 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:41.985734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504b8ab-ba48-4e9b-afa3-58e514f2d205 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:42.022361 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:42.022979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.023256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.023525 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.034534 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:42.034942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96dc7a-8fe9-4886-923c-29aeff63dc1f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:42.039705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:42.040851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:42.041832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:42.042981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 205/423] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:42.049620 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:42.100072 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:42.100971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.102490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.102904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.105391 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:42.107671 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:42.111878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 219/424] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:41 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:42.115943 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:42.141023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:42.155289 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:42.233779 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef86d3-f2e7-4ce3-9658-156a29b1aed0 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:42.282445 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a3b3-c5ca-4c88-9e1b-0f7d518918b4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:42.286312 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c442c-de5a-439a-a265-ba383e2c5759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:42.286978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c442c-de5a-439a-a265-ba383e2c5759 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.287258 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c442c-de5a-439a-a265-ba383e2c5759 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.287523 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c442c-de5a-439a-a265-ba383e2c5759 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.288195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c442c-de5a-439a-a265-ba383e2c5759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:42.288567 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c442c-de5a-439a-a265-ba383e2c5759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:42.290929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c442c-de5a-439a-a265-ba383e2c5759 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:42.306975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 206/425] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:42.308574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a149ff-0321-457a-9eaa-135367848f85 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.308900 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a149ff-0321-457a-9eaa-135367848f85 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.309254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a149ff-0321-457a-9eaa-135367848f85 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.311761 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 207/426] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:42.318328 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a149ff-0321-457a-9eaa-135367848f85 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:42.324929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923471f-a955-40dd-9c10-dced0a825b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:42.325780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923471f-a955-40dd-9c10-dced0a825b24 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.326220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923471f-a955-40dd-9c10-dced0a825b24 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.326652 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923471f-a955-40dd-9c10-dced0a825b24 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.327913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923471f-a955-40dd-9c10-dced0a825b24 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:42.330270 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923471f-a955-40dd-9c10-dced0a825b24 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:42.332482 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 220/427] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:42 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:42.333824 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813665-59fc-4cf1-9fc2-cbb3f4a4bfa8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.334262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813665-59fc-4cf1-9fc2-cbb3f4a4bfa8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.334689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813665-59fc-4cf1-9fc2-cbb3f4a4bfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.357377 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e7813665-59fc-4cf1-9fc2-cbb3f4a4bfa8 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:42.359714 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e7813665-59fc-4cf1-9fc2-cbb3f4a4bfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:42.444265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 221/428] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:42.451285 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a149ff-0321-457a-9eaa-135367848f85 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:42.453377 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7813665-59fc-4cf1-9fc2-cbb3f4a4bfa8 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:42.460405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:42.481184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:42.533285 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf1b2-0312-4795-9500-1d1f5a554309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:42.534208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf1b2-0312-4795-9500-1d1f5a554309 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.534621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf1b2-0312-4795-9500-1d1f5a554309 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.535019 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf1b2-0312-4795-9500-1d1f5a554309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.597384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7813665-59fc-4cf1-9fc2-cbb3f4a4bfa8 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:42.639218 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:42.639824 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.640107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.640379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.641155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:42.641464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:42.642968 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:42.661410 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 222/429] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:42 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:42.703880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf1b2-0312-4795-9500-1d1f5a554309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:42.705413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf1b2-0312-4795-9500-1d1f5a554309 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:42.819487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 208/430] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:42.825725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:42.867582 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a16e-7d38-4d15-ae96-fecbe08fdc65 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.868320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a16e-7d38-4d15-ae96-fecbe08fdc65 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.868320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a16e-7d38-4d15-ae96-fecbe08fdc65 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.869707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 209/431] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:42.877290 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016def3-b769-4381-845d-b970a9b5f92c None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:42.877730 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016def3-b769-4381-845d-b970a9b5f92c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:42.877999 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016def3-b769-4381-845d-b970a9b5f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:42.898328 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:42.907327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-1016def3-b769-4381-845d-b970a9b5f92c None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:42.908590 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-1016def3-b769-4381-845d-b970a9b5f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:42.965030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:42.994234 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81479f-35d8-49a2-9eb9-6895f83a5c99 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.009926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 210/432] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:43.011287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016def3-b769-4381-845d-b970a9b5f92c None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.052858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.057206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.057773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.058688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] PATH_INFO: `/v3/projects/9c774aab3a3f410cbe5fda133641dc5c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.060437 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] RBAC: Authorizing `identity:get_project(project_id=9c774aab3a3f410cbe5fda133641dc5c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:43.062638 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:43.065983 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 223/433] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:42 2022] GET /identity/v3/projects/9c774aab3a3f410cbe5fda133641dc5c => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:43.071892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.135142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016def3-b769-4381-845d-b970a9b5f92c None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.181343 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.181917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.182196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.182528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] PATH_INFO: `/v3/roles/member` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.195490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:43.203564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:43.210812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:43.211860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:43.213996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 211/434] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:43.224948 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53dccd-8817-403f-b7fc-bfa18d99ed56 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.225926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.258740 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.259388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.259667 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.259936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.263920 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:43.263920 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:43.266192 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 224/435] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:43.275464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.297618 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:43.376749 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3af1e1-c946-403e-8742-cb8bee7a0bba None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.426928 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71021-410b-4683-88c5-6a50fcdae451 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.428718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26add7-8f63-495c-9e4f-4ff0b256eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.429339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26add7-8f63-495c-9e4f-4ff0b256eea7 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.429606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26add7-8f63-495c-9e4f-4ff0b256eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.429923 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26add7-8f63-495c-9e4f-4ff0b256eea7 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.430593 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26add7-8f63-495c-9e4f-4ff0b256eea7 None admin] RBAC: Adding query filter params (name=member) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:43.430891 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26add7-8f63-495c-9e4f-4ff0b256eea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:43.432878 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26add7-8f63-495c-9e4f-4ff0b256eea7 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:43.441750 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 212/436] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:43.442908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dcfd4-99e9-49bc-a80e-4c60f0e807f9 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.443219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dcfd4-99e9-49bc-a80e-4c60f0e807f9 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.443486 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dcfd4-99e9-49bc-a80e-4c60f0e807f9 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.444846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 213/437] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:43.446850 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dcfd4-99e9-49bc-a80e-4c60f0e807f9 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.475677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.476286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.476562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.476859 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.477719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=9c774aab3a3f410cbe5fda133641dc5c) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:43.478023 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:43.479662 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:43.486093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 225/438] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=9c774aab3a3f410cbe5fda133641dc5c&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:43.486770 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.513429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:43.569557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dcfd4-99e9-49bc-a80e-4c60f0e807f9 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.598113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:43.619384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5385d-6495-42c5-9155-6f8ec5f5d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.620063 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5385d-6495-42c5-9155-6f8ec5f5d66d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.620441 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5385d-6495-42c5-9155-6f8ec5f5d66d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.620914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5385d-6495-42c5-9155-6f8ec5f5d66d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.622948 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078bc63-a7ed-432f-bc40-bdfc98b81b40 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.633323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5385d-6495-42c5-9155-6f8ec5f5d66d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-a5f5385d-6495-42c5-9155-6f8ec5f5d66d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:43.638667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:43.639569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:43.640505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 214/439] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:43.641575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28deb0-d256-46c7-8efc-444592f88e05 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.641720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28deb0-d256-46c7-8efc-444592f88e05 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.641988 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28deb0-d256-46c7-8efc-444592f88e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.663702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-8c28deb0-d256-46c7-8efc-444592f88e05 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:43.664940 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-8c28deb0-d256-46c7-8efc-444592f88e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:43.665987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.666603 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.667045 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.667259 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.749474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:43.749859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 215/440] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:43.751644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28deb0-d256-46c7-8efc-444592f88e05 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.753990 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:43.822483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:43.846023 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:43.874165 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 226/441] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:43.880812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:43.892186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28deb0-d256-46c7-8efc-444592f88e05 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:43.949550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:43.949550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:43.949992 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:43.950153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:43.950876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:43.951184 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:43.952570 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:43.961872 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 216/442] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:43.968776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.026891 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11073e-9a85-4259-9446-bf5cdcfea74f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.062767 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.063407 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.063685 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.063952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.065086 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.066841 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.073646 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 227/443] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:44.074488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.094010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767cb3e-8bd0-4a3c-a97b-f984a14471c9 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.104105 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.122076 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.129647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.130272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.130544 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.130809 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.174300 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34446c01-60f5-4b4c-a1f9-58e8532e8f9d None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.196462 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.198061 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.208592 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.209258 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.209537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.209806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.210907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.212368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.214220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 228/444] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:44.214869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.306618 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 217/445] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:44.307390 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.318919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.323414 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8745-4346-4d4d-8f86-1d2942cba170 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.338397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.360353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.361012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.361291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.361560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.371914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:44.376639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:44.377521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 229/446] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:44.378560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.413817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b7087-4f71-41e9-b6d9-972d653dbd60 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.448859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.449463 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.449770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.450071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.450795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=503842e4c2704f92b9ed69eb792b3c8c, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:44.451099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.452582 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.458625 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 218/447] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=503842e4c2704f92b9ed69eb792b3c8c => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:44.459468 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.484640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d455ed-4fe2-4964-ab39-e1bbd4de3046 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.525602 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.526473 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.526756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.527028 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] PATH_INFO: `/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.528363 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] RBAC: Authorizing `identity:get_project(project_id=2310cdb9aaee4d6bb40f906576dd80ab)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.529868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.531699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 230/448] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/projects/2310cdb9aaee4d6bb40f906576dd80ab => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:44.537907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.550027 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.579297 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db306f-5346-42e4-8387-7fc77d3309a4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.587682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.616952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.617317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.617820 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.618084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.618815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:44.619079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.620579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.636822 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 219/449] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:44.638634 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.658863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945b661-79f6-4ccd-9337-8056f2e5e138 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.704401 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.705094 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.705366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.705648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] PATH_INFO: `/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.707887 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] RBAC: Authorizing `identity:get_group(group_id=ec6a40ef174c4bed9b91c8e4e561c4c2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.709355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.710929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 231/450] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/groups/ec6a40ef174c4bed9b91c8e4e561c4c2 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:44.717025 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:44.758413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068b946-1acf-45da-a7ea-d2d017123a3a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.799956 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.800577 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.801096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.801374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.806367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.834222 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404b5bc-bb0b-4829-b138-82b0432f173d None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:44.848717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:44.877408 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:44.878328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:44.878521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:44.878817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:44.879515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] RBAC: Adding query filter params (group.id=ec6a40ef174c4bed9b91c8e4e561c4c2, role.id=c31d5cb4bf2d4d89863537cb77b66262, scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:44.879822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.880153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:44.881296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.881738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:44.887734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 232/451] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/role_assignments?group.id=ec6a40ef174c4bed9b91c8e4e561c4c2&scope.project.id=2310cdb9aaee4d6bb40f906576dd80ab&role.id=c31d5cb4bf2d4d89863537cb77b66262 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:44.987102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 220/452] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:44.993000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:45.108284 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0cec1-126b-4845-b90d-8ae5d956c585 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:45.141585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:45.142248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:45.142523 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:45.142791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] PATH_INFO: `/v3/projects/8a065a84a79f4e27982ec8e2b3054801` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:45.143908 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] RBAC: Authorizing `identity:get_project(project_id=8a065a84a79f4e27982ec8e2b3054801)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:45.145394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:45.147026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 233/453] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Aug 22 17:39:44 2022] GET /identity/v3/projects/8a065a84a79f4e27982ec8e2b3054801 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:45.153234 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:45.190050 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:45.255889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68624b-4823-4174-ae90-cfceaf770309 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:45.291217 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7f1d-c57f-4b93-82d9-814ef856377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:45.291918 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7f1d-c57f-4b93-82d9-814ef856377b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:45.292196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7f1d-c57f-4b93-82d9-814ef856377b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:45.292528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7f1d-c57f-4b93-82d9-814ef856377b None admin] PATH_INFO: `/v3/groups/50733fbc497b488bbfba28c22415c2a1` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:45.293640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c7f1d-c57f-4b93-82d9-814ef856377b None admin] RBAC: Authorizing `identity:get_group(group_id=50733fbc497b488bbfba28c22415c2a1)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:45.295082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c7f1d-c57f-4b93-82d9-814ef856377b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:45.296663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 221/454] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Aug 22 17:39:45 2022] GET /identity/v3/groups/50733fbc497b488bbfba28c22415c2a1 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:45.302715 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:45.349667 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:45.406815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603c29f-f983-417b-bd9d-4e25d6150afc None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:45.444335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98782b01-3750-45c3-82e7-ac16c1205ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:45.445227 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98782b01-3750-45c3-82e7-ac16c1205ffd None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:45.445595 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98782b01-3750-45c3-82e7-ac16c1205ffd None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:45.445960 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98782b01-3750-45c3-82e7-ac16c1205ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:45.447041 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98782b01-3750-45c3-82e7-ac16c1205ffd None admin] RBAC: Adding query filter params (group.id=50733fbc497b488bbfba28c22415c2a1, role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=8a065a84a79f4e27982ec8e2b3054801) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:45.447483 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98782b01-3750-45c3-82e7-ac16c1205ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:45.449692 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98782b01-3750-45c3-82e7-ac16c1205ffd None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:45.459291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 234/455] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Aug 22 17:39:45 2022] GET /identity/v3/role_assignments?group.id=50733fbc497b488bbfba28c22415c2a1&scope.project.id=8a065a84a79f4e27982ec8e2b3054801&role.id=1122faa21ccf460d936f2efb595661ff => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:48.000203 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514c95-a06a-41c1-9f8f-82e7158f5bce None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.000759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514c95-a06a-41c1-9f8f-82e7158f5bce None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.000759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514c95-a06a-41c1-9f8f-82e7158f5bce None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.002362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 222/456] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:48.007904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7446299-c852-409b-9661-66c763b73bf7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.008783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7446299-c852-409b-9661-66c763b73bf7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.009280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7446299-c852-409b-9661-66c763b73bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.028585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-b7446299-c852-409b-9661-66c763b73bf7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:48.030131 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-b7446299-c852-409b-9661-66c763b73bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:48.105507 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 235/457] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:48.230804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ec80-96f6-4ed0-9082-1e688be0a198 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.231470 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ec80-96f6-4ed0-9082-1e688be0a198 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.231953 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ec80-96f6-4ed0-9082-1e688be0a198 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.233911 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 223/458] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:48.239791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4490f6-f517-455b-9467-673e7e48a83a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.240311 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4490f6-f517-455b-9467-673e7e48a83a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.240841 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4490f6-f517-455b-9467-673e7e48a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.260282 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-dd4490f6-f517-455b-9467-673e7e48a83a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:48.267654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-dd4490f6-f517-455b-9467-673e7e48a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:48.297782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:48.311618 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4e0e-5c5c-4110-8872-0516827f89cf None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.311889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4e0e-5c5c-4110-8872-0516827f89cf None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.312316 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4e0e-5c5c-4110-8872-0516827f89cf None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.313785 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 224/459] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:48.319422 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a85a-f2bc-43ea-b0f0-eb0373a19620 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.319926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a85a-f2bc-43ea-b0f0-eb0373a19620 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.320425 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a85a-f2bc-43ea-b0f0-eb0373a19620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.339551 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-bd53a85a-f2bc-43ea-b0f0-eb0373a19620 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:48.341108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-bd53a85a-f2bc-43ea-b0f0-eb0373a19620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:48.344773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 236/460] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:48.411366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 225/461] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:48.450166 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4490f6-f517-455b-9467-673e7e48a83a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:48.553177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4490f6-f517-455b-9467-673e7e48a83a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:48.587945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:48.588977 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.589257 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.589524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.599829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aeb26-981e-48cf-93a9-10cfdc247c11 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.601852 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:48.601852 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:48.602405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aeb26-981e-48cf-93a9-10cfdc247c11 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.602880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aeb26-981e-48cf-93a9-10cfdc247c11 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.609053 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 226/462] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:48.610621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481febc3-624b-4e60-acac-869df7ae6b88 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.611093 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481febc3-624b-4e60-acac-869df7ae6b88 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.611575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481febc3-624b-4e60-acac-869df7ae6b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:48.617066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:48.617980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:48.618913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:48.618913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:48.618913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:48.618913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 237/463] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:48.624479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:48.634143 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-481febc3-624b-4e60-acac-869df7ae6b88 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:48.636164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-481febc3-624b-4e60-acac-869df7ae6b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:48.650473 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:48.673103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:48.716398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 227/464] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:48.717620 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481febc3-624b-4e60-acac-869df7ae6b88 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:48.731331 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe0e2-18dc-4549-8f3f-27cdb370925e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:48.766798 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:48.767407 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.767683 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.767948 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.768785 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:48.769234 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:48.770609 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:48.784653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 238/465] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:48.784653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:48.831120 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481febc3-624b-4e60-acac-869df7ae6b88 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:48.863708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:48.864329 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.864600 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.864892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.870040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:48.875264 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:48.876738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:48.891485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:48.892459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:48.893699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:48.893699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:48.893699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:48.893699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 228/466] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:48.893699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:48.898167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0c872-622e-4495-9580-505db29dc550 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:48.914528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:48.935494 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:48.936129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:48.936403 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:48.936705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:48.947799 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:48.949393 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:48.964780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:48.965679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:48.966515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:48.966515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:48.966515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:48.966515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 239/467] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:48.967096 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:49.001224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f56eae-4a8c-42df-9315-5b5723c42b95 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.034286 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.034994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.035281 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.035541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.036173 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.037638 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.058449 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 229/468] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:48 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:49.061751 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:49.068712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4b6b-8ab6-4929-9f7b-9f8d7bc457e4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.104856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:49.112489 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.113281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.113562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.113804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.118340 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:49.118340 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.118340 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.136194 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 240/469] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:49.136194 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:49.154788 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:49.196860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90ee1-7d49-4c52-b5c4-894d56a5fd86 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.234353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.235287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.235557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.235829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.236594 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:49.237026 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.238900 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.251019 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 230/470] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:49.252405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c7c12-c2ce-4b54-b273-490f63ad6b5a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.252537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:49.293648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.294591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.295001 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.295414 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.308492 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.310123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:49.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:49.328825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:49.329843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:49.329843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:49.329843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:49.329843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 241/471] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:49.332650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:49.370972 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3b8be-ce2c-48ce-8136-d8ddbaf87a80 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.383872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:49.415254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:49.421797 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.422413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.422687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.422954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.423943 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.425726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.449225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 231/472] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:49 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:49.450062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:49.459506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc47b-7ca0-4493-bd0e-9b21af0475e0 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.515843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.516937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.517433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.517902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.519518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.521986 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.555461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 242/473] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:49 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:49.586414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005b198-2750-43f0-8c35-1e56271352db None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.631796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965544e-bdbb-4c6d-ac46-62c272010d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.632834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965544e-bdbb-4c6d-ac46-62c272010d2c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.633339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965544e-bdbb-4c6d-ac46-62c272010d2c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.633833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965544e-bdbb-4c6d-ac46-62c272010d2c None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.634741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965544e-bdbb-4c6d-ac46-62c272010d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:49.635340 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965544e-bdbb-4c6d-ac46-62c272010d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.637158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965544e-bdbb-4c6d-ac46-62c272010d2c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.652017 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 232/474] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:49.658711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:49.772136 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:49.776385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b427be-6a3f-4963-b9ca-44aa60dbfd98 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:49.818684 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ddac-c4ed-4e4c-8849-37e1e18a6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:49.819388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ddac-c4ed-4e4c-8849-37e1e18a6d88 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:49.819731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ddac-c4ed-4e4c-8849-37e1e18a6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:49.820063 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ddac-c4ed-4e4c-8849-37e1e18a6d88 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:49.820808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ddac-c4ed-4e4c-8849-37e1e18a6d88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:49.822314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ddac-c4ed-4e4c-8849-37e1e18a6d88 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:49.846394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 243/475] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:39:49 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:39:51.402726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6f189-f643-47da-b060-750e77062f15 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:51.403254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6f189-f643-47da-b060-750e77062f15 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:51.403411 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6f189-f643-47da-b060-750e77062f15 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:51.405962 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 233/476] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:51.414600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388780a-0a21-4a2a-9a5b-7cfedd9b00e2 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:51.415080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388780a-0a21-4a2a-9a5b-7cfedd9b00e2 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:51.415149 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388780a-0a21-4a2a-9a5b-7cfedd9b00e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:51.441709 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c388780a-0a21-4a2a-9a5b-7cfedd9b00e2 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:51.442935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c388780a-0a21-4a2a-9a5b-7cfedd9b00e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:51.516177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 244/477] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:51.794985 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfe8b-eff8-435b-8b9a-50ee55769a33 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:51.795336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfe8b-eff8-435b-8b9a-50ee55769a33 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:51.795646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfe8b-eff8-435b-8b9a-50ee55769a33 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:51.797065 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 234/478] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:51.802564 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06e9e-eaad-4fcf-b86e-f209a724b21a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:51.802854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06e9e-eaad-4fcf-b86e-f209a724b21a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:51.803130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06e9e-eaad-4fcf-b86e-f209a724b21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:51.822248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-45b06e9e-eaad-4fcf-b86e-f209a724b21a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:51.823488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-45b06e9e-eaad-4fcf-b86e-f209a724b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:51.865055 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfe8b-eff8-435b-8b9a-50ee55769a33 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:51.900790 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 245/479] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:51.903163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175cfe-fc3a-48c2-a16e-cefc6de1297e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:51.903958 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175cfe-fc3a-48c2-a16e-cefc6de1297e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:51.904746 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175cfe-fc3a-48c2-a16e-cefc6de1297e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:51.906620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 246/480] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:51.913590 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9ac7-73b2-4b1e-a8f6-a929e1fa9b84 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:51.913869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9ac7-73b2-4b1e-a8f6-a929e1fa9b84 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:51.914139 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9ac7-73b2-4b1e-a8f6-a929e1fa9b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:51.934986 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-039e9ac7-73b2-4b1e-a8f6-a929e1fa9b84 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:51.936206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-039e9ac7-73b2-4b1e-a8f6-a929e1fa9b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:51.937795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:51.950411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.024719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 247/481] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:52.025929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfe8b-eff8-435b-8b9a-50ee55769a33 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.061138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.061718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.061994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.062259 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] PATH_INFO: `/v3/roles/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.067528 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c21c-e9cb-43fb-9bc4-3f88c15ea4da None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.067812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c21c-e9cb-43fb-9bc4-3f88c15ea4da None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.068080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c21c-e9cb-43fb-9bc4-3f88c15ea4da None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.069675 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 248/482] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:39:52.076136 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cde99-c6ca-4e4b-b625-f59a91c5ba74 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.076571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cde99-c6ca-4e4b-b625-f59a91c5ba74 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.077372 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cde99-c6ca-4e4b-b625-f59a91c5ba74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.080084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:52.085007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:52.085907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:52.086734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 235/483] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:52.093898 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.102260 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-765cde99-c6ca-4e4b-b625-f59a91c5ba74 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:52.104462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-765cde99-c6ca-4e4b-b625-f59a91c5ba74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:52.232743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 249/484] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:52.241672 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cde99-c6ca-4e4b-b625-f59a91c5ba74 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.253707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680f502-ea33-4c02-b69b-de336e7311db None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.264383 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.298215 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.299096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.299506 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.299909 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.300750 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:52.301275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:52.303055 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:52.312458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 236/485] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:52.321376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.343078 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.373969 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cde99-c6ca-4e4b-b625-f59a91c5ba74 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.410951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.411577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.411847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.412110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.422691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:52.427394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:52.428262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.429126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:52.429728 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 250/486] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:52.430472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.437959 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf046e-fce9-48b6-869a-78bc5ca729e9 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.478168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.478841 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.479118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.479399 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.491100 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:52.492508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:52.507260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:52.508251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:52.509121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:52.509121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:52.509121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:52.509121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 237/487] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:39:52.513906 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.540963 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.544635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a60d59-6013-45eb-a0dc-639719501829 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.581599 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.582154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.582434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.582704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.584521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.593621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:52.598275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:52.599167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:52.599981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 251/488] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:52.600860 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.618779 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6713c49-85e8-4bb3-9686-5f96229e2d45 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.653908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.654684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.655040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.655435 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.656462 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:52.656925 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:52.658934 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:52.670445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 238/489] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:52.671237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.715051 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5df6f-8c68-4a91-9bb9-430c27ace018 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.751174 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.751862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.752216 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.752518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.753199 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:52.753491 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:52.754886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:52.756241 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.767061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 252/490] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:52.772305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.773662 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f552ef-78ef-4b0d-add8-c03ae61b0605 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.807856 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.808468 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.808774 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.809039 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] PATH_INFO: `/v3/roles/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.819302 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:52.824657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:52.825697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:52.826652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 239/491] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:52.827428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.830598 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.878219 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140144-2440-47f8-b089-35fe5fa0a798 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.912974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.913586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.913862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.914122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.914781 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:52.915080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:52.916489 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:52.924455 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 253/492] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:52.925277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:52.933156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b0af7-ac1e-4d84-bdc6-31da44e1f24d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:52.967609 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:52.968233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:52.968511 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:52.968854 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:52.979480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:52.980949 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:52.983367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:52.995818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:52.996846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:53.002516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:53.002516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:53.002516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:53.002516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 240/493] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:53.002516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.029117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abdc28-3c71-48d4-995b-6121d4a9c4d8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.045258 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.063479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.064118 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.064386 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.064666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.072422 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.074138 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:39:53.086390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:53.087330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 254/494] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:53.088318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.101878 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296276d8-6090-46e5-81ce-134522e0a0c9 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.135824 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.136418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.136723 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.136992 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.137665 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:53.137968 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.139352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.150379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 241/495] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:53.150379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.196835 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276658d3-5c62-460a-a4b5-d00ef95f4d2f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.215992 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.231060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.231665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.231937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.232202 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.242600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.244090 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:53.258336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:53.259397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:53.260350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:53.260350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:53.260350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:53.260350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 255/496] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:53.260575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c2f40-061c-4a2f-beed-f6c551746628 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.260679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.292400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.298388 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.298994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.299269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.299534 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.300173 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:53.300472 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.301895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.314910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 242/497] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:53.316374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.384193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b1e13-a2ee-421a-89db-f60505c2fb71 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.418012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.418524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.418802 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.419074 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.419834 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:53.420140 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.421617 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.434483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898df2c-18ea-4946-a583-0e1754324d00 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.455945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.462194 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 256/498] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:53.463149 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.480181 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.480854 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.481129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.481396 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.491669 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.493216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:53.507875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:53.508825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:53.509676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:53.509676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:53.509676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:53.509676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 243/499] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:53.509908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.551562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.569397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa8cb8-80e0-431a-a74b-19109f4c7680 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.604176 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.604858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.605134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.605399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.606052 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:53.606346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.607725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.612807 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded7bff-7c04-42e6-9df1-b31f4f430762 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.619943 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 257/500] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:53.621000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.655019 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.655650 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.655927 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.656322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] PATH_INFO: `/v3/users/glance` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.664537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.666089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:39:53.678374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:53.684487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 244/501] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:53.685585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.719511 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.732381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17c0cc-dfbc-4c49-acaf-3835676032c4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.766435 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.767041 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.767312 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.767578 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.783143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.791110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d7a8c-3914-4b6e-87d9-01e3f5ed0720 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.826713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.827247 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.827525 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.827791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.828448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:53.828765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.830158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.838347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.839809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.841891 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 245/502] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:53.842675 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.931059 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.942204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601cfe8-69e5-4ed3-9054-4c8d146686f3 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:53.944982 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 258/503] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:53.945789 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:53.977830 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:53.978660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:53.978950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:53.979220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:53.986395 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:53.987857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:53.991903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:39:53.999014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:54.000214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:54.001129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 246/504] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:54.001682 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.049456 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d6f70-d4c8-4fcc-ad15-ee3922bc5950 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.084542 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.085163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.085456 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.085724 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.086447 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:54.086743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.088208 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.109725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 259/505] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Aug 22 17:39:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:54.110582 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.111339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bc539-024c-4cf7-b764-e08325a68cd4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.147942 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.148568 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.148885 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.149158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.157340 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.158802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:39:54.170009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:54.170950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:54.171871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 247/506] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:54.172443 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.184764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.220199 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1fccd-2393-47eb-8ea7-ab758b22c583 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.222673 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.256451 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.257103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.257374 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.257637 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.268896 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.270591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.278248 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8230d0-43b5-43bd-aa78-ef70153f7ec1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:54.285295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:54.286196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:54.287037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:54.287037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:54.287037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:54.287037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 260/507] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:54.287405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.317221 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.317834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.318144 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.318414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.319147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:54.319451 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.320917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.359923 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 248/508] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:54.361289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.395133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e005d-ef8a-4028-9f8d-876c36e7f904 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.427576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.431267 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.432207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.432481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.432777 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.458847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.466142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9879-2412-46bc-b9f6-949bbfc02a44 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.501154 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.501761 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.502044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.502310 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.502900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.503314 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:54.503398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.504367 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.504841 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.522274 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 249/509] 10.222.0.59 () {56 vars in 1139 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:54.523220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.610645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 261/510] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:54.611493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.628765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc977-a329-4e03-a085-a8294b29c21a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.654767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.663875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.664480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.664792 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.665061 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.665696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:54.666185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.668010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.670950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.679328 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 250/511] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:54.680130 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.714645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1415de4-ef3d-4e38-bde2-4999ee775299 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.747996 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.748593 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.748904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.749151 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.781904 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb296e-db23-4709-ae57-fe46bbca74ab None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:54.816305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.817821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.818083 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:54.818680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:54.818953 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:54.819220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:54.872745 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.872963 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:54.887292 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:54.888814 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:54.922864 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 262/512] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:54.922864 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:54.985717 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 251/513] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:54.986476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.023561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b9c10-d5c5-49e3-a119-b5e53dccc5ca None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.059586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.060300 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.060576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.060881 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.070081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.071213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.073172 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.085257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22741e7f-598d-49f1-ba82-91c3f896f713 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:55.087742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:55.088809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:55.089796 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:55.089796 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:55.089796 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:55.093085 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 263/514] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:55.094201 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.105078 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.119185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.119818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.120094 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.120362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.126979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.128442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:39:55.140132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:55.141213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 252/515] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:55.146946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.206205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8271a9-801f-40f0-9fff-b741759f54ca None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.241083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.241647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.242008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.242167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.247044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf3d67-a6da-4b15-a488-00a4293e4752 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.253317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.254808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:55.272156 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:55.273196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:55.274117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:55.274117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:55.274117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:55.274117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 264/516] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:55.274117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.283630 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.284264 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.284539 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.284840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.297142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.298602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.305257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:55.314075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:55.315099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:55.316278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:55.316278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:55.316278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:55.316278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 253/517] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:55.316562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.342575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.383404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e8320-435e-4adf-9b56-96bd228a2e56 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.416187 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7522f8a-ffb8-45a9-a2be-16c0c8bd5efa None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.416641 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.417255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.417524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.417795 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.418422 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:55.418717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.420168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.433686 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 265/518] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:55.434527 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.468169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.468853 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.469128 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.469372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.470063 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:55.470381 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.471833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.497723 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 254/519] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:55.498579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.546459 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57b01-7b7c-4b09-92d9-ac585034f136 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.559991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.567951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.582866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.583473 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.583752 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.584024 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.584696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:55.584995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.586374 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.598209 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 266/520] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:55.599022 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.601538 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de66b-0514-42a7-8c22-c0dd142fd49d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.636599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.637245 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.637520 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.637797 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.638435 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:55.638733 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.640099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.651369 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 255/521] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:55.652158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.704226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab61b8-b914-4683-9be6-7bc4f460e7ef None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.737229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.737848 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.738119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.738381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.745549 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.746993 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.751831 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847a7ca-c9ae-40e1-9821-c6fabdff492b None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:39:55.758548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:55.759427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:55.760368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 267/522] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:55.760872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.773149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.792211 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.793408 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.793880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.794354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.795165 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=41c4b45279d84fcbbe060dbe341f5fe6) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:55.795474 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.796942 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.803823 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 256/523] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/role_assignments?user.id=41c4b45279d84fcbbe060dbe341f5fe6&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:55.804626 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.808044 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:55.878513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939bbb0-42b9-4313-b33e-6b99a4f0896a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.918314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.918985 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.919258 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.919524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.926992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.928595 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:55.937485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45bde-8c6d-4bc3-ae06-d6323f786203 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:39:55.941974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:55.942856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:55.943828 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:55.949087 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 268/524] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:55.949756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:55.979627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:55.980413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:55.982288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:55.982288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:55.990645 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:55.993045 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:39:56.005430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:56.006311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:56.007163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 257/525] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:56.007795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:56.064201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:56.067890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:56.071090 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b5489-cd7f-4e2e-90a3-e08290272e03 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:56.105553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:56.106168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:56.106444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:56.106712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:56.107401 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:56.107698 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:56.109171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:56.127453 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 269/526] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:56.128129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:56.135180 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f154c-d01a-46c8-ae81-42271ca0cd72 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:56.171947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:56.173021 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:56.173308 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:56.173579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:56.174273 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:56.174929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:56.176748 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:56.194043 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 258/527] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:56.194043 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:56.246905 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82403e28-bfa1-4e7f-abde-02edd2623652 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:56.292591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:56.292591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:56.292591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:56.292591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:56.293003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:56.293003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:56.293003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:56.304217 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 270/528] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:56.304945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf04c76-6131-41b1-82dc-3f89b2e7552d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:56.305056 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:56.309636 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:56.330984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:56.347335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:56.347941 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:56.348220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:56.348491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:56.349243 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=a0b91ae7fe5246bb9bb838bc5a4cc099) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:56.349549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:56.350983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:56.368652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 259/529] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:56 2022] GET /identity/v3/role_assignments?user.id=a0b91ae7fe5246bb9bb838bc5a4cc099&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:56.368652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:56.431931 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b0d2f-a6a2-4126-a92e-83e051aad464 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:56.474341 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23755078-3d73-4631-81c3-82f7f314de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:56.474955 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755078-3d73-4631-81c3-82f7f314de12 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:56.475248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755078-3d73-4631-81c3-82f7f314de12 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:56.475501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755078-3d73-4631-81c3-82f7f314de12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:56.476233 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23755078-3d73-4631-81c3-82f7f314de12 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=51c432d2d2ec4be6b34839a86ce15036) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:56.476536 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23755078-3d73-4631-81c3-82f7f314de12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:56.478050 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23755078-3d73-4631-81c3-82f7f314de12 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:56.485593 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 271/530] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:56 2022] GET /identity/v3/role_assignments?user.id=51c432d2d2ec4be6b34839a86ce15036&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:56.502098 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a87b-5633-490a-a44f-a2aa8f067084 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:56.544815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42c615-0d20-4786-ac3b-5303624d15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:56.545606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42c615-0d20-4786-ac3b-5303624d15e6 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:56.545947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42c615-0d20-4786-ac3b-5303624d15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:56.546283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42c615-0d20-4786-ac3b-5303624d15e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:56.547117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42c615-0d20-4786-ac3b-5303624d15e6 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=17d25b471b4a4c78bea1456094b584c4) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:56.547492 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42c615-0d20-4786-ac3b-5303624d15e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:56.549142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42c615-0d20-4786-ac3b-5303624d15e6 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:56.556430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 260/531] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:39:56 2022] GET /identity/v3/role_assignments?user.id=17d25b471b4a4c78bea1456094b584c4&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:58.024584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ae2b-46b8-4dbb-870a-e7d121b743b8 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.025328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ae2b-46b8-4dbb-870a-e7d121b743b8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.025328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ae2b-46b8-4dbb-870a-e7d121b743b8 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.026969 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 272/532] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:58.032304 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8a59-7458-42c8-99cd-a6334bf37ff1 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.032835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8a59-7458-42c8-99cd-a6334bf37ff1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.032989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8a59-7458-42c8-99cd-a6334bf37ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.051707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-cc4a8a59-7458-42c8-99cd-a6334bf37ff1 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:58.052939 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-cc4a8a59-7458-42c8-99cd-a6334bf37ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:58.078548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:58.126002 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 261/533] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:58.464162 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ae2b-46b8-4dbb-870a-e7d121b743b8 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:58.563836 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:58.590784 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ae2b-46b8-4dbb-870a-e7d121b743b8 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:58.629351 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:58.630009 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.630282 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.630548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.643310 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9517d40-75a3-4f96-87af-772a4b52e593 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.643638 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9517d40-75a3-4f96-87af-772a4b52e593 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.643735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:58.643912 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9517d40-75a3-4f96-87af-772a4b52e593 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.645637 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 262/534] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:58.648658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:58.649576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:58.650534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:58.652714 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03a66f-5e8d-44a4-86b1-89f313546da1 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.653136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03a66f-5e8d-44a4-86b1-89f313546da1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.653496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03a66f-5e8d-44a4-86b1-89f313546da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.654897 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 273/535] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:58.656189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:58.672487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-ec03a66f-5e8d-44a4-86b1-89f313546da1 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:58.673881 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-ec03a66f-5e8d-44a4-86b1-89f313546da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:58.748376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 263/536] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:58.754599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3006-3c10-436f-96e4-e4ba8146eadd None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.755450 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3006-3c10-436f-96e4-e4ba8146eadd None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.756032 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3006-3c10-436f-96e4-e4ba8146eadd None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.762064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0aaba-fbd2-405c-8fc0-1ef774e48d58 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:58.762204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 264/537] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:58.763687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc767-2ed3-4446-bdc0-89377242233b None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.763961 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc767-2ed3-4446-bdc0-89377242233b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.764225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc767-2ed3-4446-bdc0-89377242233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.782552 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-761cc767-2ed3-4446-bdc0-89377242233b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:58.783735 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-761cc767-2ed3-4446-bdc0-89377242233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:58.805370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c15e-38b9-459e-a7b5-229bd9ef3c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:58.805984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c15e-38b9-459e-a7b5-229bd9ef3c95 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.806313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c15e-38b9-459e-a7b5-229bd9ef3c95 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.806607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c15e-38b9-459e-a7b5-229bd9ef3c95 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.807248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c15e-38b9-459e-a7b5-229bd9ef3c95 None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:58.807551 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c15e-38b9-459e-a7b5-229bd9ef3c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:58.808987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c15e-38b9-459e-a7b5-229bd9ef3c95 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:58.817718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 274/538] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:58.818831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567d1c9-007a-456d-a932-e515f2f3831d None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.819120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567d1c9-007a-456d-a932-e515f2f3831d None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.819394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567d1c9-007a-456d-a932-e515f2f3831d None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.825048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 275/539] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:39:58.825048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567d1c9-007a-456d-a932-e515f2f3831d None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:58.832555 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:58.867447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 265/540] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:58.869174 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc0ce8-fc17-4f68-9aac-c43f77da060a None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.869610 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc0ce8-fc17-4f68-9aac-c43f77da060a None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.870012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc0ce8-fc17-4f68-9aac-c43f77da060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.900334 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-90bc0ce8-fc17-4f68-9aac-c43f77da060a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:39:58.902296 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-90bc0ce8-fc17-4f68-9aac-c43f77da060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:39:58.921552 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:58.938272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567d1c9-007a-456d-a932-e515f2f3831d None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:58.976457 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:58.977359 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:58.977770 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:58.978193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:58.989020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:58.990635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:58.993003 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 266/541] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:59.005656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:59.006717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:59.007681 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:59.007681 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:59.007681 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:59.009291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 276/542] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:59.015138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc0ce8-fc17-4f68-9aac-c43f77da060a None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.078443 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.119424 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc0ce8-fc17-4f68-9aac-c43f77da060a None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.141470 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.156599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.157237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.157504 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.157791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.158417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:59.158765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:59.160155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:59.176702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 267/543] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:39:59.179236 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.196669 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.198494 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57f8a-c5fe-438d-97f7-47c245f52b54 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.239150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.239783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.240062 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.240333 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.250794 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:59.255992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:59.256880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:59.257764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 277/544] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:59.258440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.306040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9da57-d990-4171-ac8b-e918fd538063 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.340693 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.341318 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.341588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.341948 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.349682 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:59.351147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:39:59.362575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:59.363512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 268/545] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:59.364414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.376815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944be32-28e5-4ac9-9f73-498abb48af15 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.393621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.411016 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.411472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.411758 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.412008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.422310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:59.427427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:59.428318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:59.429146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 278/546] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:59.429804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.440699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.472845 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa756ea-a25b-4307-a034-a8f799cdd791 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.512698 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.513233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.513514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.513786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.514461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:59.514760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:59.516193 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:59.524327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 269/547] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:59.525197 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.538331 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4e2f-b9b9-45eb-bba4-4d6a9cd7c63c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.573655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.574278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.574549 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.574942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.586102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:39:59.591735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:59.592721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:39:59.593522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 279/548] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:59.594347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.634591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87bd9-27c1-49f0-88c6-baf47297b40d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.635549 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.663201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.668562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.669205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.669478 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.669785 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.670566 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:59.670863 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:59.672305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:59.690239 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 270/549] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:59.691042 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.698926 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e1804-ccdc-4728-9112-c20ed248e12c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.732551 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.733187 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.733463 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.733738 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.734426 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:59.734727 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:59.736120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:59.745775 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 280/550] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:59.747250 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.789122 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598ac3-b190-4f36-825c-0c6766f7e9bc None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.823777 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.824408 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.824725 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.825001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.835304 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:59.836820 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:59.843678 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.847051 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebed216-eb37-4bc4-a4fc-1217acdee1b7 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:39:59.851327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:39:59.852397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:39:59.854417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:39:59.854417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:39:59.854417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:39:59.854417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 271/551] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:39:59.854417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.881048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.881648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.881904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.882174 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:39:59.882838 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:39:59.883140 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:39:59.884697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:39:59.892624 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 281/552] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:39:59.893417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:39:59.901757 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:59.958813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5564-30e1-41a8-ad9e-8ce750c90066 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.991770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:39:59.992404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b7dba-ca6b-46d2-b187-c885070ab4ad None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:39:59.992576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:39:59.992704 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:39:59.993011 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.003619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.005130 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:00.022299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:00.023371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:00.024366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:00.024366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:00.024366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:00.024366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 272/553] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:00.025506 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.034925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.035557 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.035831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.036123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.048121 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.049575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:00.063902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:00.070317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:00.071385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:00.071385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:00.071385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:00.071385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 282/554] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:00.071385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.084423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.123798 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.130975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4d20-dd6d-4573-a2b9-6da3edb4189a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.165473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.166376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.166666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.166948 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.167589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:00.167892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.169304 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.173921 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaa077-b0b3-47e3-96e7-2065ebbde2dc None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.181023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 273/555] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:00.181926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.215405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.215683 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.215975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.227343 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.228696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:00.243353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:00.245122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:00.246682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:00.246682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:00.246682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:00.246682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 283/556] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:00.246682 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.287856 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb005-97aa-4f90-87a4-4f855ee30cb8 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.314530 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.322093 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.322863 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.323164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.323434 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.324113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:00.324446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.325929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.339041 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 274/557] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:00.340148 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.353780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efeea-0762-4c2b-b009-2989d81db191 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.357541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.389221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.389802 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.390097 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.390365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.391190 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:00.391494 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.392900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.409248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 284/558] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:00.409248 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.442994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce35ec1-0db3-406c-99ac-d2d461675ca1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.474967 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.475592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.475872 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.476138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.483452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.484943 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:00.495611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:00.497226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 275/559] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:00.498502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.512757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b48608-274c-4a2a-93c4-24d0a8672e6e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.540106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.551774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.552384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.552692 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.552961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.553595 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:00.553890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.555247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.567277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 285/560] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:00.567923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.583628 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.610456 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb83f6-4499-48d2-974c-c609fe8d2be8 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.644473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.645179 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.645429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.645697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.652576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.654103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:00.665350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:00.666372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 276/561] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:00.667266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.676472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989925-974f-4f20-b404-e2e1e2e45b09 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.712524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.713184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.713464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.713730 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.721350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.722819 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:00.734158 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:00.735084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 286/562] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:00.736128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.773388 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697c10-203b-4244-a801-e47d97ec8f79 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.781808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.809009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.809613 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.809897 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.810169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.810894 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:00.811194 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.812701 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.814282 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:00.831790 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 277/563] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:00.832538 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.842002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ff595-4114-4de6-a2c6-7f15d648d217 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.874909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.875503 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.875781 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.876048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.883577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.885117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:00.896104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:00.897070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 287/564] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:00.898030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.934517 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d3f4a-cf9f-4fb0-8bd8-29d645db2f34 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:00.968161 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:00.968795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:00.969077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:00.969351 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:00.970032 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:00.970336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:00.971768 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:00.983789 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 278/565] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:00.984707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:00.997134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a1504-ccf3-4dab-ba8e-840523ca3a31 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.005019 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.036554 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.037193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.037469 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.037734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.038470 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:01.038769 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.040195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.041961 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.057905 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 288/566] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:01.058730 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.089277 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55bd91-da13-4b59-8b9d-10fe34734053 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.122844 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.123473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.123759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.124021 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.135192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.136700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:01.150509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:01.151471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:01.152353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:01.152353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:01.152353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:01.152353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 279/567] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:01.152585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.158688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040bf1-7263-4b07-8793-d40d04b2f407 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.194984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.195591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.195851 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.196116 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.196916 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:01.197209 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.198628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.215935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 289/568] 10.222.0.59 () {56 vars in 1139 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:01.216784 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.241471 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.252437 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e11351-3a20-4511-b3ab-2367b93d991e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.254735 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.290323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.291036 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.291315 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.291588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] PATH_INFO: `/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/41c4b45279d84fcbbe060dbe341f5fe6/roles/694a30076f6245a7bc4ed75fa9ef9818` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.306479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=cb47a6c68ef54e3d97e6df4288eaf596, user_id=41c4b45279d84fcbbe060dbe341f5fe6, role_id=694a30076f6245a7bc4ed75fa9ef9818)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.307969 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.317556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb05d6-dc24-4583-9230-a52ca55dd4a8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.321376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 280/569] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:40:01 2022] PUT /identity/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/41c4b45279d84fcbbe060dbe341f5fe6/roles/694a30076f6245a7bc4ed75fa9ef9818 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:40:01.322249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.370681 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.371230 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.371502 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.371766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.385372 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.387509 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:01.403822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:01.410362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:01.411412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:01.411412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:01.411412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:01.411412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 290/570] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:01.411412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.450484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6ef8-c7d0-4cae-ba5f-206f62de1b5b None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.490671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.491645 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.491914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.492020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.492183 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.492954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:01.493387 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.494858 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.508003 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 281/571] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:01.508768 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.531511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c3c56-adae-4134-8364-c7f5190ad651 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.535118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.570540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.571172 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.571443 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.571777 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.583441 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.584925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:01.600370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:01.601413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:01.602375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:01.602375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:01.602375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:01.602375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 291/572] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:01.602375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.632979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd020bc-bb74-4c6b-a8ce-a64ddab5ad9a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.672257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.673001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.673280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.673602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.674247 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:01.674542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.675909 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.688646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 282/573] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:01.690071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.721559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca056115-938b-400e-9fb5-01b52edf8556 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.749370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.759800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.760536 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.760841 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.761221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.766339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.769872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.771446 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:01.783741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:01.784863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 292/574] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:01.785962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.799663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3a552-3a19-40b3-9e4f-35f7410b895d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.835047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.835655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.835931 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.836203 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.836876 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:01.837178 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.838864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.854676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 283/575] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:01.854676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.903032 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed8327-1d34-48e4-8ae1-bc9720cc8a6a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.939080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.940015 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.940304 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.940576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.947507 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.949040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:01.956190 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a398e4-ffb1-4ecd-a4a4-645583dfc9ea None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:01.960490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:01.961415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:01.962355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 293/576] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:01.962835 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:01.995492 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:01.996413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:01.996871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:01.997135 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:01.997850 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:01.998130 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:01.999605 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:02.001266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:02.012632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 284/577] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:02.013465 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:02.018731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:02.089123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900130d-f774-41e7-9058-b9c6dc395e81 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:02.124275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b109e0-6863-4469-a0e1-e6d0f26dfbcf None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:02.128201 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:02.128861 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:02.129139 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:02.129405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:02.136344 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:02.137837 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:02.149269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:02.150417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:02.151296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 294/578] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:02.151767 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:02.160962 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:02.161507 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:02.161784 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:02.162054 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:02.162738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:02.163041 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:02.164468 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:02.181861 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 285/579] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:02.181861 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:02.249071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:02.278443 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3c05a-2d06-4637-b78c-33712c0bf322 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:02.286940 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:02.297332 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d59ab9-99cf-4d48-b713-f068f4d57db1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:02.317941 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:02.319024 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:02.319304 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:02.319630 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] PATH_INFO: `/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/a0b91ae7fe5246bb9bb838bc5a4cc099/roles/694a30076f6245a7bc4ed75fa9ef9818` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:02.333863 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:02.334479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:02.334762 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:02.335022 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb47a6c68ef54e3d97e6df4288eaf596, user_id=a0b91ae7fe5246bb9bb838bc5a4cc099, role_id=694a30076f6245a7bc4ed75fa9ef9818)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:02.335118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:02.335710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:02.336015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:02.336511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:02.337491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:02.356656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 295/580] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:40:02 2022] PUT /identity/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/a0b91ae7fe5246bb9bb838bc5a4cc099/roles/694a30076f6245a7bc4ed75fa9ef9818 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:40:02.356656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:02.357053 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 286/581] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:02.363467 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:02.495176 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee044d6b-c45b-4512-b0a0-ba98a89c8066 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:02.502805 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549eea-c6af-4399-8fd7-6381140830fb None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:02.522339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:02.543075 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407cee3-6095-4c0b-b7b1-02badec35871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:02.544184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407cee3-6095-4c0b-b7b1-02badec35871 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:02.544672 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407cee3-6095-4c0b-b7b1-02badec35871 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:02.545288 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407cee3-6095-4c0b-b7b1-02badec35871 None admin] PATH_INFO: `/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/51c432d2d2ec4be6b34839a86ce15036/roles/694a30076f6245a7bc4ed75fa9ef9818` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:02.550352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a622f-9938-4b17-8c40-6464bee7f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:02.551041 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a622f-9938-4b17-8c40-6464bee7f7d2 None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:02.551326 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a622f-9938-4b17-8c40-6464bee7f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:02.551598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a622f-9938-4b17-8c40-6464bee7f7d2 None admin] PATH_INFO: `/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/17d25b471b4a4c78bea1456094b584c4/roles/694a30076f6245a7bc4ed75fa9ef9818` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:02.563853 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407cee3-6095-4c0b-b7b1-02badec35871 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb47a6c68ef54e3d97e6df4288eaf596, user_id=51c432d2d2ec4be6b34839a86ce15036, role_id=694a30076f6245a7bc4ed75fa9ef9818)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:02.566038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407cee3-6095-4c0b-b7b1-02badec35871 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:02.570434 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a622f-9938-4b17-8c40-6464bee7f7d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb47a6c68ef54e3d97e6df4288eaf596, user_id=17d25b471b4a4c78bea1456094b584c4, role_id=694a30076f6245a7bc4ed75fa9ef9818)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:02.572651 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a622f-9938-4b17-8c40-6464bee7f7d2 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:02.583450 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 296/582] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:40:02 2022] PUT /identity/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/51c432d2d2ec4be6b34839a86ce15036/roles/694a30076f6245a7bc4ed75fa9ef9818 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:40:02.591141 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 287/583] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:40:02 2022] PUT /identity/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/17d25b471b4a4c78bea1456094b584c4/roles/694a30076f6245a7bc4ed75fa9ef9818 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:40:03.527091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e2bf-57d1-4c5d-bd5b-55c968ae5220 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:03.527614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e2bf-57d1-4c5d-bd5b-55c968ae5220 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:03.527614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e2bf-57d1-4c5d-bd5b-55c968ae5220 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:03.529245 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 297/584] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:03.535432 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c2d8-757e-475d-8a4d-6b08b9a44aae None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:03.536420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c2d8-757e-475d-8a4d-6b08b9a44aae None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:03.536929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c2d8-757e-475d-8a4d-6b08b9a44aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:03.557759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-37a3c2d8-757e-475d-8a4d-6b08b9a44aae None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:03.559839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-37a3c2d8-757e-475d-8a4d-6b08b9a44aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:03.637249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 288/585] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:40:03.960764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e2bf-57d1-4c5d-bd5b-55c968ae5220 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:03.970343 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:04.066499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e2bf-57d1-4c5d-bd5b-55c968ae5220 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:04.104939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:04.105639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.105912 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.106174 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.116806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:40:04.121725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:04.122674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:04.124073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 298/586] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:40:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:04.128987 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3c2d8-757e-475d-8a4d-6b08b9a44aae None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:04.232385 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:04.239470 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3c2d8-757e-475d-8a4d-6b08b9a44aae None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:04.280653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:04.280653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.280653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.280653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.281075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:04.281075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:04.281758 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:04.291218 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 289/587] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:40:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:04.296791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:04.366016 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:04.402252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1a9b-c4e1-48a0-beda-926ab6472490 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:04.437653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:04.438283 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.438554 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.438821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.449956 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:04.451484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:04.466915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:04.467904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:04.468840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:04.468840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:04.468840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:04.468840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 299/588] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:04.473984 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:04.589919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9999-45df-41b3-9c52-69504951f236 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:04.627152 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fa3ea-ea05-43e6-8224-68b0da07a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:04.627768 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fa3ea-ea05-43e6-8224-68b0da07a062 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.628041 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fa3ea-ea05-43e6-8224-68b0da07a062 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.628311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fa3ea-ea05-43e6-8224-68b0da07a062 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.628985 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fa3ea-ea05-43e6-8224-68b0da07a062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:04.629285 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fa3ea-ea05-43e6-8224-68b0da07a062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:04.630655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fa3ea-ea05-43e6-8224-68b0da07a062 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:04.643952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 290/589] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:04.649176 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:04.705803 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2a30-d5bc-49ed-a7ed-d914668f4169 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.706496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2a30-d5bc-49ed-a7ed-d914668f4169 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.706970 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2a30-d5bc-49ed-a7ed-d914668f4169 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.708845 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 291/590] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:40:04.714452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd915f-bfd0-4b63-8488-d317a76c6fa3 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.715054 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd915f-bfd0-4b63-8488-d317a76c6fa3 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.715542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd915f-bfd0-4b63-8488-d317a76c6fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.734221 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-66dd915f-bfd0-4b63-8488-d317a76c6fa3 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:04.735862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-66dd915f-bfd0-4b63-8488-d317a76c6fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:04.754110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:04.755956 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b9f2-703b-4dc9-ac69-0d4568570b47 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:04.778286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:04.798812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:04.799581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.800309 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.800653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.808816 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:04.810376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:04.822155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:04.823237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:04.824354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:04.828804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 300/591] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Aug 22 17:40:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:04.829737 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:04.848910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 292/592] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:40:04.931768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d940b6-9d0b-44b8-9afa-8d5044706d79 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:04.932636 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c33e8-b8ab-4cf3-8c93-8a85559af6b9 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.932923 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c33e8-b8ab-4cf3-8c93-8a85559af6b9 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.933305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c33e8-b8ab-4cf3-8c93-8a85559af6b9 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.934913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 293/593] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:40:04.935962 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4c363-5f52-496b-b075-ce63e075c067 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.936278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4c363-5f52-496b-b075-ce63e075c067 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.936507 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4c363-5f52-496b-b075-ce63e075c067 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.937931 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 294/594] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:04.941412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691fee6-0305-4ceb-9392-fb9abd755be4 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.941698 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691fee6-0305-4ceb-9392-fb9abd755be4 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.941969 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691fee6-0305-4ceb-9392-fb9abd755be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.960849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-a691fee6-0305-4ceb-9392-fb9abd755be4 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:04.962103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-a691fee6-0305-4ceb-9392-fb9abd755be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:04.968556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3451d5-2ccc-4c40-acf8-3b8feba741e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:04.969195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3451d5-2ccc-4c40-acf8-3b8feba741e4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.969586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3451d5-2ccc-4c40-acf8-3b8feba741e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.969857 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3451d5-2ccc-4c40-acf8-3b8feba741e4 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:04.970582 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3451d5-2ccc-4c40-acf8-3b8feba741e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:04.970882 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3451d5-2ccc-4c40-acf8-3b8feba741e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:04.972414 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3451d5-2ccc-4c40-acf8-3b8feba741e4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:04.992783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 301/595] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Aug 22 17:40:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:04.992783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda889f-8745-4adf-9811-b0464e148b03 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:04.992783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda889f-8745-4adf-9811-b0464e148b03 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:04.993112 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda889f-8745-4adf-9811-b0464e148b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.012756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-1eda889f-8745-4adf-9811-b0464e148b03 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:05.014195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-1eda889f-8745-4adf-9811-b0464e148b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:05.040849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 295/596] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:40:05.040849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691fee6-0305-4ceb-9392-fb9abd755be4 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.052384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.107687 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 302/597] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:40:05.153537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.178893 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691fee6-0305-4ceb-9392-fb9abd755be4 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.179401 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda889f-8745-4adf-9811-b0464e148b03 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.217471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.218046 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.218319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.218582 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.292234 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:05.293910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:05.308045 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda889f-8745-4adf-9811-b0464e148b03 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.351778 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.352403 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.352754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.353179 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.364559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:40:05.369815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:05.370950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:05.372000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:05.375762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 303/598] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:40:05.376642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.387708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.406343 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.422331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 296/599] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:05.422331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.484786 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3443b-f805-44af-b126-7479d61a519a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.519250 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.519869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.520140 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.520404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.520506 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f101d0-7237-4252-9f15-6092aadbb0e8 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.531154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:40:05.535773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:05.536889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 304/600] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:05.537782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.559498 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.560082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.560351 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.560633 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.561299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:05.561576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:05.562937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:05.571359 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 297/601] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:05.572677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.614890 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.626874 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.642295 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774a08-00f3-48c9-a65d-421533232d1b None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.675271 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.675900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.676160 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.676424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.679514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043e7f-f29f-4e93-b049-d2d10074aeb4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.686826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:05.688270 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:05.703000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:05.704060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:05.705650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:05.705650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:05.705650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:05.705650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 305/602] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:05.705650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.716779 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.717439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.717753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.718025 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.728982 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:40:05.734153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:05.735212 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:05.736090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 298/603] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:05.736851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.812636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11187e-d847-4748-85da-c4aea5b22a47 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.834095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.838111 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac7e9-9093-4301-8d2e-3072ee5e1797 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:05.846951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.847564 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.847843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.848117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.848821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:05.849124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:05.850507 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:05.856661 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:05.860526 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 306/604] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:05.861376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.871941 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:05.872550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:05.872861 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:05.873134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:05.884416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:05.886089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:05.899924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:05.901095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:05.901989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:05.901989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:05.901989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:05.901989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 299/605] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:05.901989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:05.967683 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff320047-b304-4794-a195-c507df9186c8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.000840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5412f6a-af29-4176-90c1-8580cafab9e7 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.002231 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.002830 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.003116 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.003385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.004032 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.004333 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.005745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.017587 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 307/606] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.018480 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.040817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.041493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.041780 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.042051 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.042743 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.043040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.044514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.053088 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 300/607] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:40:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.053986 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.072347 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.084889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.127225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837917d-94ea-475a-af4a-e0b8a55e6e04 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.160123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b561d98-f1b2-412b-beeb-0c6381662928 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.161212 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.161837 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.162080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.162350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.173296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.174749 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:06.188695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:06.190153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:06.191103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:06.191103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:06.191103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:06.191103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 308/608] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:06.191327 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.196813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.197561 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.197837 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.198109 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.198744 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.199044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.200420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.212699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 301/609] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.213630 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.287164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.294562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027871cb-14fe-493a-85e6-661dd68e0c1d None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.307256 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.316799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103807bd-aad0-4d12-913e-4238b5ad8bba None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.329357 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.329976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.330247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.330514 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.337185 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.338805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:06.349689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:06.350757 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 309/610] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:06.351844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.354354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.355892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.356173 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.356448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.366773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.368267 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:06.382542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:06.383680 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:06.384548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:06.384548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:06.384548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:06.384548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 302/611] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:06.384548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.453467 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093008bf-218a-445c-9a65-8929b9a0211f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.487309 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf53860-1aa8-4da2-b5b7-f2a07359b226 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.489537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.490219 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.490500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.490772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.491450 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.491753 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.493161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.505148 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 310/612] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.505952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.510084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.520819 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.521478 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.521761 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.522023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] PATH_INFO: `/v3/users/glance` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.529611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.531047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.541183 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:06.542767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:06.543719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 303/613] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:06.544945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.611768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90165d2a-0889-4b03-afe6-88426fc734c1 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.647008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717da815-86d1-4198-8114-b7595d294362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.647537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da815-86d1-4198-8114-b7595d294362 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.647815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da815-86d1-4198-8114-b7595d294362 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.648081 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da815-86d1-4198-8114-b7595d294362 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.648800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717da815-86d1-4198-8114-b7595d294362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.648909 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e59f54-eb70-425a-861f-688a3be8eb8e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.649320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717da815-86d1-4198-8114-b7595d294362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.650972 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717da815-86d1-4198-8114-b7595d294362 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.662542 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 311/614] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.663348 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717da815-86d1-4198-8114-b7595d294362 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.687530 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.688153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.688432 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.688726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.689698 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.689989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.691382 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.704106 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 304/615] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.704878 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.752597 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.756970 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.766268 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717da815-86d1-4198-8114-b7595d294362 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.801192 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.801819 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.802095 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.802369 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.807107 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057aaba-b16d-4318-92c0-67742bdd56b4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.810397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.811856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:06.823942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:06.824981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 312/616] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:06.825927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.846438 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.847044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.847316 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.847646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.848378 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.848703 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.850140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.869110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 305/617] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.870191 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.931395 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b23a79-f4d4-450c-a298-21ab9da8b107 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.965770 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:06.966372 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:06.966647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:06.966923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:06.967642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=41c4b45279d84fcbbe060dbe341f5fe6) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:06.967947 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:06.968866 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa149a6-6d70-44d3-8899-de4c9010f441 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:06.969428 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:06.970397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:06.975299 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 313/618] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/role_assignments?user.id=41c4b45279d84fcbbe060dbe341f5fe6&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:06.976122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:06.997736 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.019553 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.020540 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.020858 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.021131 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.029984 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.031478 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:07.045339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:07.046366 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:40:07.047313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:07.051393 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 306/619] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:07.052349 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.105255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54aec-5930-489a-9346-08172b7b6f23 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:07.143933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.144552 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.144864 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.145144 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.145886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:07.146186 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.147652 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.166895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad568be-9e0c-4c0b-a95a-ae1de792530e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:07.168237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 314/620] 10.222.0.59 () {56 vars in 1139 bytes} [Mon Aug 22 17:40:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:07.169262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.207340 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.207883 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.208164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.208437 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.248659 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.263552 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.291196 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890e8a8-8713-4e0d-b72a-35f60762aee9 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:07.292464 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.294060 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.333812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.334424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.334698 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.334967 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.335694 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:07.335994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.337680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.356146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 315/621] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:07.361260 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.402425 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 307/622] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:07.403432 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.471486 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607c9cd-120b-43d7-a7b8-dfdee0449919 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:07.471667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.506098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.512580 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.513542 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.514064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.514553 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.519126 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae947-ce09-40d8-910b-413f13e03a0f None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:07.556304 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.557038 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.557315 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.557580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.590421 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.591905 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.648703 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.651425 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.705766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 316/623] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:07.705766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.723319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.737647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.765619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 308/624] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:07.766523 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.815325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac073-1a1d-4413-8229-5ed8ebf31241 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:07.851621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.852256 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.852532 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.852831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.863704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.865252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.879580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c9271-c6db-453f-8856-4c8724e62668 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:07.881113 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:07.882126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:07.883012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:07.883012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:07.883012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:07.883012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 317/625] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:07.883233 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.922774 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:07.923401 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:07.923703 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:07.923948 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:07.935121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:07.936573 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:07.952192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:07.953338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:07.954394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:07.954394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:07.954394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:07.958109 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 309/626] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:07.958999 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:07.979868 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.985323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.003577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088a082-ac80-4953-96f7-1d1581e82707 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.040960 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.041585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.041858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.042126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.054195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.055789 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:08.070800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:08.071890 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:08.072833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:08.072833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:08.072833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:08.072833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 318/627] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:08.073789 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.079826 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240297b-9a12-4583-9e8a-9be80378249e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.115696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.116309 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.116589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.116886 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.117567 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.117865 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.120134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.132266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 310/628] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:08.133124 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.203580 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ad63a-2f8a-4fe3-aa60-3fb240c4a417 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.213245 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.238765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666874ae-6bbb-4e78-9f65-0bdc3288c5c7 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.240552 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.241220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.241497 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.242399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.242399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.242714 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.244370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.247313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.257545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 319/629] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:08.258830 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.283437 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.284059 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.284357 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.284603 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.285281 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.285580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.287030 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.299242 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 311/630] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:08.299840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.375195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fa153-afc5-4563-9526-e55e1ccbfa5e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.406704 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493294f-1df2-4bfe-a536-f05c68e3e9db None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.410984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.411614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.411892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.412163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.419079 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.420563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:08.432039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:08.433129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 320/631] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:08.438976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.453198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.453951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.454300 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.454670 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.456775 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.464222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.466411 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:08.478418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:08.479346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 312/632] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:08.480252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.501600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.548806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41978c9-0a92-4633-bdc0-2c2f34295d91 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.584316 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.584989 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.585266 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.585537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.586905 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdef6b-53e8-47c5-805f-cfe4c0c30c49 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.593008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.594527 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:08.605747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:08.606691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 321/633] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:08.607614 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.633483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.634140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.634413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.634648 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.635367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.635663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.637124 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.649483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 313/634] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:08.655029 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.713892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d647-a5ec-4721-98a4-a0e7df7e9362 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.722845 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.731700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.749742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.750343 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.750617 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.750886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.751570 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.751919 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.753327 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.766354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 322/635] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:08.771935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.772493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712fd2-e227-40fd-82e9-9cb418c64dad None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.811140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.811750 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.812030 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.812354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.813099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.813454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.815233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.833096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 314/636] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:08.833096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.881804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c568c-4ac2-40fb-a6e8-7cff58e452e5 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.919411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.920045 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.920297 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.920564 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.921318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=a0b91ae7fe5246bb9bb838bc5a4cc099) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.921618 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.923049 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:08.929145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 323/637] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/role_assignments?user.id=a0b91ae7fe5246bb9bb838bc5a4cc099&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:08.941680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:08.943202 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730393-2b16-413c-baba-c9e7f690352c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:08.960975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.989161 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5fee2-9520-4188-bfb2-38cbed4ff479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:08.989967 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fee2-9520-4188-bfb2-38cbed4ff479 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:08.990078 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fee2-9520-4188-bfb2-38cbed4ff479 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:08.990323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fee2-9520-4188-bfb2-38cbed4ff479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:08.991074 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5fee2-9520-4188-bfb2-38cbed4ff479 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=17d25b471b4a4c78bea1456094b584c4) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:08.991410 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5fee2-9520-4188-bfb2-38cbed4ff479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:08.992974 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5fee2-9520-4188-bfb2-38cbed4ff479 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:09.000445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 315/638] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/role_assignments?user.id=17d25b471b4a4c78bea1456094b584c4&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:09.013912 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:09.081748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab71d0f-bd21-44e3-b2aa-f23618891ab8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:09.125661 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae9c54-6fcb-4b06-a17f-67b48bf8dff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:09.126570 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9c54-6fcb-4b06-a17f-67b48bf8dff6 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:09.126994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9c54-6fcb-4b06-a17f-67b48bf8dff6 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:09.127407 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9c54-6fcb-4b06-a17f-67b48bf8dff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:09.128343 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae9c54-6fcb-4b06-a17f-67b48bf8dff6 None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=51c432d2d2ec4be6b34839a86ce15036) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:09.128844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae9c54-6fcb-4b06-a17f-67b48bf8dff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:09.130513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae9c54-6fcb-4b06-a17f-67b48bf8dff6 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:09.138020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 324/639] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:40:08 2022] GET /identity/v3/role_assignments?user.id=51c432d2d2ec4be6b34839a86ce15036&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:09.274647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f87b-0dc2-46f0-bc46-9b5c95268772 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:09.274848 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f87b-0dc2-46f0-bc46-9b5c95268772 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:09.275888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f87b-0dc2-46f0-bc46-9b5c95268772 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:09.276942 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 316/640] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:09.283667 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc105c22-dee7-432a-aefd-fe2ace329f23 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:09.283958 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc105c22-dee7-432a-aefd-fe2ace329f23 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:09.284213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc105c22-dee7-432a-aefd-fe2ace329f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:09.304068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-fc105c22-dee7-432a-aefd-fe2ace329f23 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:09.305314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-fc105c22-dee7-432a-aefd-fe2ace329f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:09.375867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 325/641] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:40:09.702465 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599f87b-0dc2-46f0-bc46-9b5c95268772 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:09.811396 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599f87b-0dc2-46f0-bc46-9b5c95268772 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:09.846279 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:09.846960 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:09.847242 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:09.847509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:09.858163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:40:09.864192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:09.865231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:09.866113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 317/642] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:09.871333 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc105c22-dee7-432a-aefd-fe2ace329f23 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:09.908215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:09.978329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc105c22-dee7-432a-aefd-fe2ace329f23 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:10.013647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:10.014252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:10.014523 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:10.014784 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:10.015447 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:10.015738 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:10.017214 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:10.027107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 326/643] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:10.033149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:10.078689 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:10.145070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cfe27-a9a9-47d2-8c4b-98b08a6558cc None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:10.181158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:10.181795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:10.182074 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:10.182348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:10.194379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:10.195991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:10.211071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:10.213505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:10.214766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:10.214766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:10.214766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:10.214766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 318/644] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:10.217926 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:10.333070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:10.339838 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6dba-43c8-4d8f-a7e9-0e0cd02effdc None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:10.376489 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:10.377171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:10.377457 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:10.377725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:10.378389 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:10.378686 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:10.380054 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:10.392886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 327/645] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:10.398564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:10.494101 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:10.504954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6fb0e-5bf3-4e5c-a499-0b4a26ea1960 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:10.539919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:10.540585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:10.540902 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:10.541214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:10.548734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:10.550167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:10.561457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:10.562392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:10.563331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 319/646] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Aug 22 17:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:10.568719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:10.671368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f5ef5-852c-4a52-8ddb-4a086b42c4fe None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:10.706642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:10.707257 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:10.707536 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:10.707807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:10.708545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:10.708884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:10.710319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:10.729265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 328/647] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Aug 22 17:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:10.734701 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:10.843765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8e88f-3897-4e61-903f-b130db4a31b1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:10.878397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:10.879288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:10.879722 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:10.880131 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:10.908336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:10.950080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:10.951540 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:11.054995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 320/648] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:11.060771 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:11.077802 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:11.171559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54e7c1-7696-42b7-9b29-99e6f5410ce4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:11.208706 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d3342-0388-4ea1-85c2-b57c58b955ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:11.209627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3342-0388-4ea1-85c2-b57c58b955ee None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.210074 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3342-0388-4ea1-85c2-b57c58b955ee None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.210486 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3342-0388-4ea1-85c2-b57c58b955ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.222812 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d3342-0388-4ea1-85c2-b57c58b955ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:11.224639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d3342-0388-4ea1-85c2-b57c58b955ee None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-f29d3342-0388-4ea1-85c2-b57c58b955ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:11.241394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:11.242607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:11.243743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:11.243743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:11.243743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:11.245734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 329/649] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:11.253155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:11.324630 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:11.380028 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351520ec-869d-4a59-a0c9-84dbb163c179 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:11.383642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7dd70-ed57-452b-a7f0-a9a972f8b4bb None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.384177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7dd70-ed57-452b-a7f0-a9a972f8b4bb None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.384592 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7dd70-ed57-452b-a7f0-a9a972f8b4bb None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.386371 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 330/650] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:11.391800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2fe34-0c24-431f-8328-56ef21c98d90 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.392297 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2fe34-0c24-431f-8328-56ef21c98d90 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.392746 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2fe34-0c24-431f-8328-56ef21c98d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.411319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-5ea2fe34-0c24-431f-8328-56ef21c98d90 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:11.412933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-5ea2fe34-0c24-431f-8328-56ef21c98d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:11.421960 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:11.422990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.422990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.423416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.424157 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:11.424550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:11.426188 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:11.443415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 321/651] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:11.444759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:11.479565 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:11.487241 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 331/652] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:40:11.488481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487333bf-9ca1-472a-8b9d-6dec83fee704 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.488793 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487333bf-9ca1-472a-8b9d-6dec83fee704 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.489067 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487333bf-9ca1-472a-8b9d-6dec83fee704 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.492825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 332/653] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:11.492825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffc0e-84eb-4077-a235-4958cdd8602a None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.492825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffc0e-84eb-4077-a235-4958cdd8602a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.492825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffc0e-84eb-4077-a235-4958cdd8602a None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.493620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 333/654] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:11.495687 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293289-0977-4286-bc82-776c3b246807 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.496060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293289-0977-4286-bc82-776c3b246807 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.496465 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293289-0977-4286-bc82-776c3b246807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.517833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e2293289-0977-4286-bc82-776c3b246807 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:11.519378 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e2293289-0977-4286-bc82-776c3b246807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:11.550113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be07ca-ee41-433f-8641-0fd4ac8a04e0 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:11.561567 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:11.588219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:11.589010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.589386 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.589766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.594408 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 334/655] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:40:11.595633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837492a-bd24-49d9-a4b6-feb3e4b0b85a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.595919 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837492a-bd24-49d9-a4b6-feb3e4b0b85a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.596185 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837492a-bd24-49d9-a4b6-feb3e4b0b85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.606094 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:11.607802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:11.614041 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-7837492a-bd24-49d9-a4b6-feb3e4b0b85a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:11.615334 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-7837492a-bd24-49d9-a4b6-feb3e4b0b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:11.622091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:11.623147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:11.624168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:11.626636 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 322/656] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:11.632493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:11.723516 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 335/657] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:40:11.753367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955476-5b61-4c76-ba89-7a326989e189 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:11.788082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:11.788926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.789347 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.789829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.790663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:11.791142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:11.792753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:11.805761 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 323/658] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:11.811621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837492a-bd24-49d9-a4b6-feb3e4b0b85a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:11.812074 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:11.851632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:11.872479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:11.925558 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837492a-bd24-49d9-a4b6-feb3e4b0b85a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:11.940458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089476e1-4b87-4415-88ab-f081eaf9eb7c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:11.966098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:11.967040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.967756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.968584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] PATH_INFO: `/v3/services/network` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.969615 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:11.971932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:11.976074 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:11.976640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:11.976919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:11.977202 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:11.978065 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=41c4b45279d84fcbbe060dbe341f5fe6) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:11.978370 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:11.979795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:11.985345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:11.986339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:11.987225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:11.987978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 324/659] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/role_assignments?user.id=41c4b45279d84fcbbe060dbe341f5fe6&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=1122faa21ccf460d936f2efb595661ff => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:11.987978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:11.989400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 336/660] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:11.995429 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:12.095471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:12.104884 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f392e5-3bc1-4729-ab63-13c22621ee05 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.116002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700ab37-7918-4768-a8e1-a2a231073cf1 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.141321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:12.145437 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805b647-222c-4564-84db-bd589575af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.146327 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b647-222c-4564-84db-bd589575af71 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.146476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b647-222c-4564-84db-bd589575af71 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.146757 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b647-222c-4564-84db-bd589575af71 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.147378 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805b647-222c-4564-84db-bd589575af71 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.148832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805b647-222c-4564-84db-bd589575af71 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.158975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.159596 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.159873 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.160142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.160833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] RBAC: Adding query filter params (name=network) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:12.161136 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-0805b647-222c-4564-84db-bd589575af71 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:12.161702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:12.162708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:12.163569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:12.164309 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.164379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 325/661] 10.222.0.59 () {56 vars in 1129 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:12.164379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805b647-222c-4564-84db-bd589575af71 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:12.177389 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 337/662] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:12.177389 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:12.280531 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805b647-222c-4564-84db-bd589575af71 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.291952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd994a06-26b3-40c9-8a0f-9ef77cb3bbcc None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.318091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.318822 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.319098 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.319374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] PATH_INFO: `/v3/services/image` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.319935 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.321725 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.329464 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.330103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.330383 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.330654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:12.330770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:12.331685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:12.332537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:12.333302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:12.333302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.333436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 326/663] 10.222.0.59 () {56 vars in 1105 bytes} [Mon Aug 22 17:40:12 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:12.333436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:12.339115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.349002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 338/664] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Aug 22 17:40:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:12.349002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:12.360652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:12.402878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:12.444494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7726227-c4cf-458c-b3c9-0093ed03cdfc None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.458231 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2e83-9f72-469b-981c-3255d1157286 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.482225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.482841 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.483124 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.483398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.484038 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] RBAC: Adding query filter params (type=network) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:12.484341 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.485758 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.491670 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 327/665] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:12.492459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:12.509739 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.510689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.511186 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.511724 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.512773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] RBAC: Adding query filter params (name=image) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:12.513303 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.514929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.520923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 339/666] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:12.527163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:12.606444 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:12.626293 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f124dc-2832-4ddb-8789-74b65ba70619 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.657573 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2b7e-bcd9-4b05-bf27-ebcd73a9b2ad None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:12.667565 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334e4e1-bde4-4b2e-983b-02b3b98bebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.668786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e4e1-bde4-4b2e-983b-02b3b98bebb6 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.669294 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e4e1-bde4-4b2e-983b-02b3b98bebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.669795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e4e1-bde4-4b2e-983b-02b3b98bebb6 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.670746 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334e4e1-bde4-4b2e-983b-02b3b98bebb6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:12.671346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334e4e1-bde4-4b2e-983b-02b3b98bebb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.673278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:12.673605 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334e4e1-bde4-4b2e-983b-02b3b98bebb6 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.681287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 328/667] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Aug 22 17:40:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:12.712394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918690c-71c1-480f-993e-36baf2f01218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:12.713119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918690c-71c1-480f-993e-36baf2f01218 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:12.713394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918690c-71c1-480f-993e-36baf2f01218 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:12.713663 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918690c-71c1-480f-993e-36baf2f01218 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:12.714318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918690c-71c1-480f-993e-36baf2f01218 None admin] RBAC: Adding query filter params (type=image) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:12.714620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918690c-71c1-480f-993e-36baf2f01218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:12.716046 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918690c-71c1-480f-993e-36baf2f01218 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:12.722910 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 340/668] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:14.213215 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd8957-e5af-43ae-9d42-d7153b15b3c0 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.213749 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd8957-e5af-43ae-9d42-d7153b15b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.213749 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd8957-e5af-43ae-9d42-d7153b15b3c0 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.215380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 329/669] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:14.220708 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6fd91-e380-40d0-adf3-59112d2bc7c8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.221130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6fd91-e380-40d0-adf3-59112d2bc7c8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.221272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6fd91-e380-40d0-adf3-59112d2bc7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.240620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-1fa6fd91-e380-40d0-adf3-59112d2bc7c8 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:14.241822 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-1fa6fd91-e380-40d0-adf3-59112d2bc7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:14.320871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 341/670] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:40:14.652436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd8957-e5af-43ae-9d42-d7153b15b3c0 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:14.761879 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd8957-e5af-43ae-9d42-d7153b15b3c0 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:14.800216 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:14.800873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.801150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.801419 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.812275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:40:14.817783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:14.818710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:14.820362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 330/671] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:14.822110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd334-312e-4146-a9c1-f4a833877b99 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.822398 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd334-312e-4146-a9c1-f4a833877b99 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.822671 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd334-312e-4146-a9c1-f4a833877b99 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.824146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 342/672] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:14.825133 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:14.831388 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637f65-c0a7-456a-a542-3bea1a4b7c00 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.831767 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637f65-c0a7-456a-a542-3bea1a4b7c00 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.832128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637f65-c0a7-456a-a542-3bea1a4b7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.838544 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:14.857068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-b1637f65-c0a7-456a-a542-3bea1a4b7c00 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:14.858961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-b1637f65-c0a7-456a-a542-3bea1a4b7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:14.934674 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dccb59-426f-4cba-b190-20fe5a74fbfb None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:14.941936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 343/673] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:40:14.946100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435cb8-d91c-410b-bb3b-0fb3ed6ee71c None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.947581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435cb8-d91c-410b-bb3b-0fb3ed6ee71c None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.947581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435cb8-d91c-410b-bb3b-0fb3ed6ee71c None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.948672 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 344/674] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:14.953635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56299a-aba7-4486-9830-2f65f96e31c8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.954093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56299a-aba7-4486-9830-2f65f96e31c8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.954542 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56299a-aba7-4486-9830-2f65f96e31c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.978140 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-2b56299a-aba7-4486-9830-2f65f96e31c8 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:14.978335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:14.979102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:14.979473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:14.979869 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:14.980168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-2b56299a-aba7-4486-9830-2f65f96e31c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:14.980828 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:14.981224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:14.982766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:14.993124 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 331/675] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:15.001619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.019323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:15.069608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 345/676] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 17:40:15.071539 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a94271-c3bc-43ad-b77c-22d9cd50c666 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.072198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a94271-c3bc-43ad-b77c-22d9cd50c666 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.073011 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a94271-c3bc-43ad-b77c-22d9cd50c666 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.074941 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 346/677] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:15.082697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97acfe-569f-4a50-b6f2-5f2385b842a6 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.083241 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97acfe-569f-4a50-b6f2-5f2385b842a6 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.083679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97acfe-569f-4a50-b6f2-5f2385b842a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.084854 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:15.103513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-fe97acfe-569f-4a50-b6f2-5f2385b842a6 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:15.105098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-fe97acfe-569f-4a50-b6f2-5f2385b842a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:15.116665 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29fd6d-4b76-4b05-8741-6388ba202d8c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:15.155336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:15.155961 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.156243 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.156506 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.167976 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:15.169533 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:15.178938 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 347/678] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:15.184584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:15.185591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:15.186481 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:15.186481 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:15.186481 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:15.186481 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 332/679] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:15.198278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97acfe-569f-4a50-b6f2-5f2385b842a6 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.292207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.303255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:15.310951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97acfe-569f-4a50-b6f2-5f2385b842a6 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:15.349804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:15.350442 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.350731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.351004 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.351671 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:15.352075 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:15.354008 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:15.372322 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 348/680] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:15.377910 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.413219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd56a-da03-4397-8719-f442c2b9cde1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:15.438065 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:15.449664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:15.450426 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.450703 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.450971 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.451616 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:15.453025 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:15.469904 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 333/681] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:40:15 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:15.470677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.499678 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e3211-4313-4fa6-9ccb-172c628f42a8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:15.550278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:15.551254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.551541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.551810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] PATH_INFO: `/v3/users/nova` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.561281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:15.562800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:15.576971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:15.578171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 349/682] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Aug 22 17:40:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:15.579161 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.597950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:15.607119 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a7936-d38a-443e-a006-a67e03e665c4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:15.645241 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:15.645859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.646134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.646399 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.647045 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:15.648442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:15.668670 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 334/683] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:40:15 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:15.668670 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.726199 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d1faa-66c5-4409-8028-d7175bd5191f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:15.739853 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:15.785023 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:15.785636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.785909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.786172 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.786919 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:15.788935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:15.820671 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 350/684] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:40:15 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:15.824166 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5b663-a786-485b-a63e-7c4db75cc6af None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:15.884069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:15.884723 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:15.885006 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:15.885275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:15.886078 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:15.886384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:15.888015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:15.910606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 335/685] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Aug 22 17:40:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:15.916017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:15.997866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:16.036803 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220db6fe-26fc-4ca3-b93b-cfa5b59ccdd6 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:16.078629 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:16.079262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:16.079520 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:16.079809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:16.093039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:16.094495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:16.109048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:16.110021 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:16.110903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:16.110903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:16.110903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:16.110903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 351/686] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:16.116141 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:16.223644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:16.230009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fe8fa-4035-4239-89b0-20c9ae9ee57e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:16.267776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:16.268314 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:16.268591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:16.268898 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:16.271815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:16.271815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:16.271815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:16.283795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 336/687] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:16.289430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:16.393448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8db0-ebaa-45c4-a73b-4fec094597c5 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:16.414630 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:16.429132 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:16.429789 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:16.430145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:16.430424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:16.437855 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:16.439651 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:16.450902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:16.451800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:16.452743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 352/688] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:16.458103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:16.559971 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba421df-56cf-4e00-9f29-418fbfcea75e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:16.594363 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc1b5a-1070-41a7-af32-cb3767031d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:16.595022 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc1b5a-1070-41a7-af32-cb3767031d60 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:16.595300 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc1b5a-1070-41a7-af32-cb3767031d60 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:16.595573 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc1b5a-1070-41a7-af32-cb3767031d60 None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:16.596264 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc1b5a-1070-41a7-af32-cb3767031d60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:16.596563 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc1b5a-1070-41a7-af32-cb3767031d60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:16.598205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc1b5a-1070-41a7-af32-cb3767031d60 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:16.611507 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 337/689] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:16.617563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:16.720734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250cb78-5324-4af4-9dc3-1c9eb2203503 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:16.757443 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee42d6c-26eb-4b9f-9acb-1b80f83cfb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:16.758507 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee42d6c-26eb-4b9f-9acb-1b80f83cfb02 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:16.758978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee42d6c-26eb-4b9f-9acb-1b80f83cfb02 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:16.759453 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee42d6c-26eb-4b9f-9acb-1b80f83cfb02 None admin] PATH_INFO: `/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/41c4b45279d84fcbbe060dbe341f5fe6/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:16.761607 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee42d6c-26eb-4b9f-9acb-1b80f83cfb02 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb47a6c68ef54e3d97e6df4288eaf596, user_id=41c4b45279d84fcbbe060dbe341f5fe6, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:16.763369 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee42d6c-26eb-4b9f-9acb-1b80f83cfb02 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:16.777866 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 353/690] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:40:16 2022] PUT /identity/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/41c4b45279d84fcbbe060dbe341f5fe6/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:40:17.863486 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a546-631a-403b-9397-e921a71978dc None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:17.864014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a546-631a-403b-9397-e921a71978dc None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:17.864014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a546-631a-403b-9397-e921a71978dc None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:17.865635 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 338/691] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:17.871543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf4ad-33bb-4809-8212-72ce0123be2c None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:17.872408 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf4ad-33bb-4809-8212-72ce0123be2c None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:17.872925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf4ad-33bb-4809-8212-72ce0123be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:17.895220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-7e6cf4ad-33bb-4809-8212-72ce0123be2c None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:17.896808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-7e6cf4ad-33bb-4809-8212-72ce0123be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:17.935228 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:17.969773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 354/692] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:17.979846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bb815-4137-4fa6-ac06-7e4212acd27a None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:17.980395 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bb815-4137-4fa6-ac06-7e4212acd27a None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:17.980932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bb815-4137-4fa6-ac06-7e4212acd27a None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:17.983809 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 339/693] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:17.988334 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d24cff-ec26-4547-b79b-1bacafbe054e None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:17.988642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d24cff-ec26-4547-b79b-1bacafbe054e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:17.988908 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d24cff-ec26-4547-b79b-1bacafbe054e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.008568 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-44d24cff-ec26-4547-b79b-1bacafbe054e None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:18.010203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-44d24cff-ec26-4547-b79b-1bacafbe054e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:18.083955 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 355/694] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:18.198955 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1c84c-9187-45fc-8a04-daa940cc27c7 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.199267 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1c84c-9187-45fc-8a04-daa940cc27c7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.199444 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1c84c-9187-45fc-8a04-daa940cc27c7 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.201120 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 340/695] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:18.210060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8aa3-f089-4701-8cf5-c2e03293ffaa None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.210565 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8aa3-f089-4701-8cf5-c2e03293ffaa None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.211053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8aa3-f089-4701-8cf5-c2e03293ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.230077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-aacb8aa3-f089-4701-8cf5-c2e03293ffaa None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:18.231584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-aacb8aa3-f089-4701-8cf5-c2e03293ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:18.308730 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 356/696] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:18.318056 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1c84c-9187-45fc-8a04-daa940cc27c7 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.337504 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:18.421773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1c84c-9187-45fc-8a04-daa940cc27c7 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:18.435486 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8aa3-f089-4701-8cf5-c2e03293ffaa None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.459968 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:18.460520 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.460826 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.461095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] PATH_INFO: `/v3/services/network` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.461736 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:18.463121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:18.472069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:18.473091 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:18.473908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 341/697] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:18.477015 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:18.478976 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.561172 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8aa3-f089-4701-8cf5-c2e03293ffaa None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:18.586400 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:18.604205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:18.605430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.605778 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.606116 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.606779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:18.608854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:18.611524 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607c8d-7d3a-4425-92ce-7a76f84b2f77 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:18.619301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:18.620317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:18.621184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:18.624748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 357/698] 10.222.0.59 () {56 vars in 1129 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:40:18.628002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.658696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:18.659463 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.659744 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.660333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.661266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] RBAC: Adding query filter params (name=network) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:18.661570 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:18.663435 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:18.668428 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 342/699] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:18.669253 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.737929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:18.746712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34d191-3c40-404c-a1a8-da2a09390797 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:18.777240 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6e5f-7e1b-498d-9360-a84e324ee3c4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:18.781339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:18.781955 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.782232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.782501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.783134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:18.783434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:18.784837 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:18.794759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 358/700] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:18.794759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.818742 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:18.819477 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.819755 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.820139 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] PATH_INFO: `/v3/services/image` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.820896 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:18.822426 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:18.831857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:18.833150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:18.834013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 343/701] 10.222.0.59 () {56 vars in 1105 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:18.834798 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.848203 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:18.905124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257222-3b03-439a-a18f-70c9617eeb12 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:18.945902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:18.946571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.946844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.947116 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.947756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] RBAC: Adding query filter params (type=network) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:18.948056 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:18.949470 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:18.949891 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac631ed-a77b-4d7c-82fd-0e65e138106d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:18.954888 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 359/702] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:18.955695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:18.984591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:18.990945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:18.991514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:18.991775 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:18.992101 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:18.992845 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:18.993138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:18.994522 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.004338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 344/703] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:19.004338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.072249 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b208dc4-cd8e-4fee-b2ba-9007edb07d04 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.083853 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:19.106542 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.107154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.107427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.107695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.108316 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] RBAC: Adding query filter params (name=image) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:19.108633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.109605 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e362b66-a018-4898-a133-6f8ee3831d87 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.110032 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.114535 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 360/704] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:19.115302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.145385 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1d05c-1597-4eea-9119-fa60448c8457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.145996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1d05c-1597-4eea-9119-fa60448c8457 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.146271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1d05c-1597-4eea-9119-fa60448c8457 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.146544 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1d05c-1597-4eea-9119-fa60448c8457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.147241 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1d05c-1597-4eea-9119-fa60448c8457 None admin] RBAC: Adding query filter params (interface=public, service_id=8a469e192a4f49b4bffb7ab6998fe7cb, region_id=RegionOne) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:19.147545 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1d05c-1597-4eea-9119-fa60448c8457 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.149014 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1d05c-1597-4eea-9119-fa60448c8457 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.156240 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 345/705] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Aug 22 17:40:18 2022] GET /identity/v3/endpoints?service_id=8a469e192a4f49b4bffb7ab6998fe7cb&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:19.157427 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c2123-3292-44f8-81f7-f743124218e7 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.157712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c2123-3292-44f8-81f7-f743124218e7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.157985 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c2123-3292-44f8-81f7-f743124218e7 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.159158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 346/706] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:19.159846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c2123-3292-44f8-81f7-f743124218e7 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.208457 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:19.223886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc08ef-52ad-46ef-9297-76acd9a1c890 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.259184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.259362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c2123-3292-44f8-81f7-f743124218e7 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.259721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.260000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.260270 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.261007 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] RBAC: Adding query filter params (interface=public, service_id=3043c11c8a714fd2aafe6a1143123471, region_id=RegionOne) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:19.261311 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.262691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.270452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 361/707] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/endpoints?service_id=3043c11c8a714fd2aafe6a1143123471&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:19.271100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.297157 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f70f39-f352-46ea-b6ab-83ca1ef44bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.297767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f70f39-f352-46ea-b6ab-83ca1ef44bfc None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.298044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f70f39-f352-46ea-b6ab-83ca1ef44bfc None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.298317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f70f39-f352-46ea-b6ab-83ca1ef44bfc None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.298947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f70f39-f352-46ea-b6ab-83ca1ef44bfc None admin] RBAC: Adding query filter params (type=image) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:19.299249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f70f39-f352-46ea-b6ab-83ca1ef44bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.300638 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f70f39-f352-46ea-b6ab-83ca1ef44bfc None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.307088 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 347/708] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:19.308277 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0844c-ff2c-496c-b23f-8229fe636b3c None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.308560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0844c-ff2c-496c-b23f-8229fe636b3c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.311016 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0844c-ff2c-496c-b23f-8229fe636b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.315284 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:19.327821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-0be0844c-ff2c-496c-b23f-8229fe636b3c None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:19.329061 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-0be0844c-ff2c-496c-b23f-8229fe636b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:19.384406 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d181-59a2-4585-85de-91d612b30cba None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.395557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 348/709] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:19.396398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0844c-ff2c-496c-b23f-8229fe636b3c None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.424181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.425615 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.426077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.426543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.427745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.429602 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.436168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 362/710] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/services => generated 1002 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:40:19.437560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.467205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:19.518422 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0844c-ff2c-496c-b23f-8229fe636b3c None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.557685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:19.563882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.565104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.565482 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.565847 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.566603 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.568197 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.575610 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 349/711] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:40:19.590763 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea2aef-9546-4de6-8735-392862b1d2d8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.631651 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.632285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.632559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.632909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.633728 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] RBAC: Adding query filter params (interface=public, service_id=2323d1ee8e354fa7bc6974eb21c6e389, region_id=RegionOne) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:19.634088 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.635602 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.642446 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 363/712] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/endpoints?service_id=2323d1ee8e354fa7bc6974eb21c6e389&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:19.647916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.738957 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:19.805117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf59b2e-67e4-4f6e-a6de-0a80de8d3ae3 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.845870 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:19.851891 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.852515 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.853001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.853271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.854533 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:19.856339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:19.864409 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 350/713] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/services => generated 1002 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:40:19.872121 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912d39-effe-4304-b32f-f3df7cf634d8 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:19.912281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:19.912992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:19.913221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:19.913474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:19.925979 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:40:19.932329 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:19.933376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:19.934211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 364/714] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:19.940175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:20.013418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:20.060541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7030-7cd8-40eb-a8b1-7d042b189a47 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:20.096447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:20.097097 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:20.097369 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:20.097632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:20.098437 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:20.098730 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:20.100096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:20.109884 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 351/715] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:20.115652 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:20.227100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bda22-35d3-47d5-bdce-8d8b1624676f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:20.262901 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:20.263541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:20.263814 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:20.267129 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:20.271499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:20.275945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:20.277988 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:20.292722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:20.293734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:20.295278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:20.295278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:20.295278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:20.295278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 365/716] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:20.300036 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:20.406741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac94e-75f0-49fe-91e7-0dbd63bd40e8 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:20.430434 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:20.443549 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:20.444488 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:20.445050 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:20.445548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:20.446402 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:20.446903 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:20.448498 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:20.461493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 352/717] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:20.469087 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:20.571783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00992ae-680d-4c79-adff-de968e6f0995 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:20.606482 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:20.607123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:20.607399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:20.607669 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] PATH_INFO: `/v3/users/nova` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:20.615457 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:20.617043 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:20.628654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:20.629697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:20.630665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 366/718] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Aug 22 17:40:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:20.637858 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:20.746313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7e115-2676-454c-9df3-b33e3fc4fd23 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:20.782621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:20.783233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:20.783512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:20.783783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:20.784512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:20.784864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:20.786300 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:20.804602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 353/719] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Aug 22 17:40:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:20.813052 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:20.865608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:20.917897 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dfb08-d830-4e8b-83d0-290c325e2980 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:20.953814 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:20.954426 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:20.954701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:20.954968 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.032902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:21.034383 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:21.089630 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:21.138646 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 367/720] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:40:20 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:40:21.144347 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:21.187858 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:21.252201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e0e4f-e623-4c55-a473-b76cfdb5644f None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:21.299862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:21.300420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.300727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.301001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.311902 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:21.313712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:21.329070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:21.330057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:21.330951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:21.330951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:21.330951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:21.330951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 354/721] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:21.337479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:21.442392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eae7ff-5cc6-4720-b363-b9a638b12c69 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:21.605348 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:21.606411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.606968 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.607431 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.608319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:21.608851 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:21.610416 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:21.623844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 368/722] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:21.629986 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:21.737007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:21.751980 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66bc98-4ced-4d99-9c5e-d836c3c555f2 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:21.801166 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6ece-91c4-4135-a03b-7499638cb522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:21.801806 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6ece-91c4-4135-a03b-7499638cb522 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.802082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6ece-91c4-4135-a03b-7499638cb522 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.802351 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6ece-91c4-4135-a03b-7499638cb522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.809910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6ece-91c4-4135-a03b-7499638cb522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:21.811465 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6ece-91c4-4135-a03b-7499638cb522 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-199f6ece-91c4-4135-a03b-7499638cb522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:21.823416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:21.824348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:21.825664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 355/723] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:21.830917 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:21.844035 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:21.874887 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b9bf-ece5-438e-b9e1-b0ac3a68dc90 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.875064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b9bf-ece5-438e-b9e1-b0ac3a68dc90 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.876027 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b9bf-ece5-438e-b9e1-b0ac3a68dc90 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.878606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 356/724] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:40:21.884167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4e479-a8ad-492d-b4e4-a0f17377cfeb None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.884440 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4e479-a8ad-492d-b4e4-a0f17377cfeb None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.884737 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4e479-a8ad-492d-b4e4-a0f17377cfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.905978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-08b4e479-a8ad-492d-b4e4-a0f17377cfeb None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:21.907295 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-08b4e479-a8ad-492d-b4e4-a0f17377cfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:21.953787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d84d-46ac-422d-b0f2-8de4fe037128 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:21.984766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 357/725] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:40:21.986095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e4c4-0174-4ed2-932c-ab4fed3c5e1e None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.986378 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e4c4-0174-4ed2-932c-ab4fed3c5e1e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.986648 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e4c4-0174-4ed2-932c-ab4fed3c5e1e None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.988081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 358/726] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:21.993981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e44d-704c-47c7-af05-3390d1cf0ae1 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.994272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e44d-704c-47c7-af05-3390d1cf0ae1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.994479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e44d-704c-47c7-af05-3390d1cf0ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.996197 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:21.997119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:21.997705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:21.998276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:21.999308 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:21.999871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.001800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.018258 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-6986e44d-704c-47c7-af05-3390d1cf0ae1 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:22.021442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-6986e44d-704c-47c7-af05-3390d1cf0ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:22.028677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 369/727] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:22.030739 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.089939 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 359/728] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:22.109310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:22.143245 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47266714-a736-4f46-92fd-33a1eca0867b None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.176827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7097-2f4e-44e0-aaf3-d40c37fa9a1f None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.177337 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7097-2f4e-44e0-aaf3-d40c37fa9a1f None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.177614 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7097-2f4e-44e0-aaf3-d40c37fa9a1f None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.179028 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 360/729] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:40:22.179130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.179808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.180087 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.180884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.181112 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=41c4b45279d84fcbbe060dbe341f5fe6) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:22.181418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.182860 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.189826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 370/730] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/role_assignments?user.id=41c4b45279d84fcbbe060dbe341f5fe6&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=1122faa21ccf460d936f2efb595661ff => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:22.191564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f542d-b447-48ed-bdfb-6d660f474e68 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.192049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f542d-b447-48ed-bdfb-6d660f474e68 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.192528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f542d-b447-48ed-bdfb-6d660f474e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.212492 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-526f542d-b447-48ed-bdfb-6d660f474e68 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:22.214219 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-526f542d-b447-48ed-bdfb-6d660f474e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:22.224334 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:22.307997 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 361/731] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:22.322638 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.434215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2b49-b91b-45ad-b8dc-b320ee9d657c None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.438082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f542d-b447-48ed-bdfb-6d660f474e68 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.476825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.477718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.478006 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.478280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] PATH_INFO: `/v3/services/network` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.478865 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.480250 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.484670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:22.493821 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:22.494902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:22.495733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 371/732] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:22.501305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.567408 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f542d-b447-48ed-bdfb-6d660f474e68 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.613317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.614514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.615214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.615657 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.616823 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.618763 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.619289 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773df77-c17a-4f73-8892-f7928603489d None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:22.630012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:22.631020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 17:40:22.631867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:22.634101 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 362/733] 10.222.0.59 () {56 vars in 1129 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:40:22.639673 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.651580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:22.661500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.662115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.662399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.662669 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.663304 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] RBAC: Adding query filter params (name=network) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:22.663608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.665465 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.670111 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 372/734] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:22.670913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.734525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:22.749217 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16515-cc7e-4b94-b4ce-95e45072f048 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.775960 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015186-af4c-428a-b269-a90554b3f37a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.783637 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.784249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.784525 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.784822 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.785477 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:22.785756 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.787139 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.796924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 363/735] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:22.796924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.819285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.819913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.820212 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.820477 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] PATH_INFO: `/v3/services/image` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.821097 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.822456 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:22.831133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:22.832189 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:22.833102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 373/736] 10.222.0.59 () {56 vars in 1105 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:22.834738 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.880307 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:22.916591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c181afd-7b86-4a8f-9ad5-1b712e54d669 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.942256 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b217b-dc28-456f-92a8-d3f7593a652e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:22.953235 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.953998 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.954279 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.954546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.955172 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] RBAC: Adding query filter params (type=network) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:22.955469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.956929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.966847 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 364/737] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:22.966847 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:22.974448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:22.984978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:22.985559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:22.985809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:22.986073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:22.986719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:22.987012 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:22.988376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:22.998544 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 374/738] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:22.998544 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:23.107444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a48b-1ec9-4c47-820d-ac60daa713e1 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:23.145887 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:23.146819 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:23.147241 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:23.147650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:23.148925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:23.150657 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:23.175207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 375/739] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:40:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:23.176386 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:23.223320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f884799-a59f-479c-8cd4-0783f7e4383a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:23.230527 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:23.287887 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:23.296263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:23.297244 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:23.297799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:23.298231 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:23.299138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] RBAC: Adding query filter params (name=image) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:23.299581 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:23.301281 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:23.311901 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 365/740] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:23.313538 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a009246-5084-4880-894e-7cb56556c3b6 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:23.316381 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:23.354644 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:23.355265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:23.355502 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:23.355772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:23.356441 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:23.358153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:23.388672 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 376/741] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:40:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:23.456289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7b10b-7e30-4319-a55e-40b89a8ff07e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:23.503948 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28145b9c-a1ff-49eb-a8af-491c674e592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:23.504663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28145b9c-a1ff-49eb-a8af-491c674e592d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:23.504953 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28145b9c-a1ff-49eb-a8af-491c674e592d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:23.505226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28145b9c-a1ff-49eb-a8af-491c674e592d None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:23.505883 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28145b9c-a1ff-49eb-a8af-491c674e592d None admin] RBAC: Adding query filter params (type=image) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:23.506185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28145b9c-a1ff-49eb-a8af-491c674e592d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:23.507617 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28145b9c-a1ff-49eb-a8af-491c674e592d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:23.513825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 366/742] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:23.519929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:23.629552 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d8b46-eedc-45a7-b133-fe0d3c5df089 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:23.631220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:23.666626 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1c707-9d7f-4b4f-98b7-a04bb3f462ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:23.667211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1c707-9d7f-4b4f-98b7-a04bb3f462ca None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:23.667481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1c707-9d7f-4b4f-98b7-a04bb3f462ca None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:23.667741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1c707-9d7f-4b4f-98b7-a04bb3f462ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:23.668526 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1c707-9d7f-4b4f-98b7-a04bb3f462ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:23.669905 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1c707-9d7f-4b4f-98b7-a04bb3f462ca None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:23.690508 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 377/743] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:40:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:24.599267 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ce4d-69c3-4612-807f-246a4fbbbf31 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:24.599866 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ce4d-69c3-4612-807f-246a4fbbbf31 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:24.599866 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ce4d-69c3-4612-807f-246a4fbbbf31 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:24.601392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 367/744] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:40:24.607307 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaf245-bf56-480a-85f4-534b5b2ccff3 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:24.607742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaf245-bf56-480a-85f4-534b5b2ccff3 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:24.607840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaf245-bf56-480a-85f4-534b5b2ccff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:24.627747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-a0aaf245-bf56-480a-85f4-534b5b2ccff3 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:24.628980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-a0aaf245-bf56-480a-85f4-534b5b2ccff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:24.708030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 378/745] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:24 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:25.051914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ce4d-69c3-4612-807f-246a4fbbbf31 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:25.115023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:25.164592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ce4d-69c3-4612-807f-246a4fbbbf31 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:25.200293 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:25.200952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:25.201278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:25.201545 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:25.202117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:25.203471 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:25.212827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:25.213839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:25.214773 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 368/746] 10.222.0.59 () {56 vars in 1132 bytes} [Mon Aug 22 17:40:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:25.221860 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaf245-bf56-480a-85f4-534b5b2ccff3 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:25.315799 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:25.333067 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaf245-bf56-480a-85f4-534b5b2ccff3 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:25.368020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100aa59-b131-4b72-afa6-32020112a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:25.368640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100aa59-b131-4b72-afa6-32020112a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:25.368924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100aa59-b131-4b72-afa6-32020112a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:25.369184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100aa59-b131-4b72-afa6-32020112a1d5 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:25.369804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100aa59-b131-4b72-afa6-32020112a1d5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:25.370098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100aa59-b131-4b72-afa6-32020112a1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:25.371442 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100aa59-b131-4b72-afa6-32020112a1d5 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:25.376183 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 379/747] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Aug 22 17:40:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:25.382209 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:25.492247 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e3880-02da-4545-87fa-604b25c8b3d1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:25.515891 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:25.536261 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a0fd9-2a3e-4eec-9594-837c13d33b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:25.536964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a0fd9-2a3e-4eec-9594-837c13d33b34 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:25.537570 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a0fd9-2a3e-4eec-9594-837c13d33b34 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:25.537835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a0fd9-2a3e-4eec-9594-837c13d33b34 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:25.538464 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a0fd9-2a3e-4eec-9594-837c13d33b34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:25.538875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a0fd9-2a3e-4eec-9594-837c13d33b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:25.540288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a0fd9-2a3e-4eec-9594-837c13d33b34 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:25.545360 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 369/748] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Aug 22 17:40:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:40:25.635458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554daf-3a22-49f2-a2a1-9e9f19ff0fbb None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:25.635969 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554daf-3a22-49f2-a2a1-9e9f19ff0fbb None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:25.635969 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554daf-3a22-49f2-a2a1-9e9f19ff0fbb None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:25.637497 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 380/749] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:25.643339 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc43f8-a53e-4a6b-872f-9d428bd9e27f None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:25.643858 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc43f8-a53e-4a6b-872f-9d428bd9e27f None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:25.643858 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc43f8-a53e-4a6b-872f-9d428bd9e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:25.663331 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-72bc43f8-a53e-4a6b-872f-9d428bd9e27f None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:25.664781 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-72bc43f8-a53e-4a6b-872f-9d428bd9e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:25.740501 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 370/750] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:25.941423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429da911-3bb9-49d9-a440-80a9a1887753 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:25.941599 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429da911-3bb9-49d9-a440-80a9a1887753 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:25.941872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429da911-3bb9-49d9-a440-80a9a1887753 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:25.943466 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 381/751] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:25.948883 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0d485-c353-40e8-a673-5b793a114135 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:25.949165 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0d485-c353-40e8-a673-5b793a114135 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:25.949429 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0d485-c353-40e8-a673-5b793a114135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:25.967797 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-56d0d485-c353-40e8-a673-5b793a114135 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:25.969012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-56d0d485-c353-40e8-a673-5b793a114135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:26.048946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 371/752] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:26.072559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429da911-3bb9-49d9-a440-80a9a1887753 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:26.179125 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429da911-3bb9-49d9-a440-80a9a1887753 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:26.215642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:26.216207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:26.216461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:26.216759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:26.217334 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:26.218777 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:26.228655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:26.229670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:26.230501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:26.234661 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 382/753] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:26.237714 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0d485-c353-40e8-a673-5b793a114135 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:26.286673 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:26.346786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0d485-c353-40e8-a673-5b793a114135 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:26.371200 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:26.380844 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:26.381453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:26.381728 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:26.381994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:26.382676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:26.382968 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:26.384338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:26.386633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:26.392933 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 372/754] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:26.394987 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:26.490418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d5a02-8f74-4b92-bd2b-ab83772a23c4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:26.498668 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6763b-ef6a-4ea2-82dc-7efc7abc96d4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:26.506252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:26.533982 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:26.534697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:26.534974 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:26.535241 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:26.535924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:26.536226 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:26.536381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:26.537000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:26.537278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:26.537547 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:26.537694 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:26.552919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 373/755] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:26.616660 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:26.618253 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:26.636349 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:26.740834 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 383/756] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:40:26 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 17:40:26.747073 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:26.851170 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086167-3ad5-4a7e-b0db-fd6f495b4801 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:26.885607 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc2ac1-8d7e-4fc8-865a-d8bbd68b540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:26.886245 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc2ac1-8d7e-4fc8-865a-d8bbd68b540f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:26.886514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc2ac1-8d7e-4fc8-865a-d8bbd68b540f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:26.886778 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc2ac1-8d7e-4fc8-865a-d8bbd68b540f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:26.897295 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc2ac1-8d7e-4fc8-865a-d8bbd68b540f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:26.898945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc2ac1-8d7e-4fc8-865a-d8bbd68b540f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-99fc2ac1-8d7e-4fc8-865a-d8bbd68b540f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:40:26.913140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:26.914229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:40:26.915117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:40:26.915117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:40:26.915117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:26.915117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 374/757] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:26.920424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:27.022925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6ab10-64b2-4470-a0d3-8e1c7cea900e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:27.036696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:27.059894 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196f00d-0a65-4899-920a-3af34db39e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:27.060506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196f00d-0a65-4899-920a-3af34db39e81 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:27.060825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196f00d-0a65-4899-920a-3af34db39e81 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:27.061099 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196f00d-0a65-4899-920a-3af34db39e81 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:27.061739 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196f00d-0a65-4899-920a-3af34db39e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:27.062036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196f00d-0a65-4899-920a-3af34db39e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:27.063734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196f00d-0a65-4899-920a-3af34db39e81 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:27.076054 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 384/758] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:27.765526 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f077-065d-48d2-9ccf-ae5d82ef7b08 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:27.766077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f077-065d-48d2-9ccf-ae5d82ef7b08 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:27.766077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f077-065d-48d2-9ccf-ae5d82ef7b08 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:27.767373 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 375/759] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:27.772921 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c7a2-6e7a-471b-9e25-a1a1ba158de0 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:27.773344 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c7a2-6e7a-471b-9e25-a1a1ba158de0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:27.773584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c7a2-6e7a-471b-9e25-a1a1ba158de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:27.794398 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-4e08c7a2-6e7a-471b-9e25-a1a1ba158de0 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:27.795634 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4e08c7a2-6e7a-471b-9e25-a1a1ba158de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:27.868982 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 385/760] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:27 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:28.190440 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7f077-065d-48d2-9ccf-ae5d82ef7b08 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:28.216265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:28.304631 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7f077-065d-48d2-9ccf-ae5d82ef7b08 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:28.341589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fe507-e990-4d97-be01-61b3524c98db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:28.342186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fe507-e990-4d97-be01-61b3524c98db None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:28.342458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fe507-e990-4d97-be01-61b3524c98db None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:28.342723 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fe507-e990-4d97-be01-61b3524c98db None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:28.343353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fe507-e990-4d97-be01-61b3524c98db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:28.344754 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fe507-e990-4d97-be01-61b3524c98db None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:28.360277 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 376/761] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:40:28 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:28.739065 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e6f9-20bd-4cda-b9d2-2e7fe9fb336b None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:28.739325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e6f9-20bd-4cda-b9d2-2e7fe9fb336b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:28.739625 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e6f9-20bd-4cda-b9d2-2e7fe9fb336b None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:28.740986 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 386/762] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:28.746834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1ebf-efcf-47e1-b425-2ba8fbbb1bad None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:28.747114 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1ebf-efcf-47e1-b425-2ba8fbbb1bad None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:28.747387 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1ebf-efcf-47e1-b425-2ba8fbbb1bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:28.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-980e1ebf-efcf-47e1-b425-2ba8fbbb1bad None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:28.766803 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-980e1ebf-efcf-47e1-b425-2ba8fbbb1bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:28.847871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 377/763] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:28 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:40:29.171595 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e6f9-20bd-4cda-b9d2-2e7fe9fb336b None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:29.278499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e6f9-20bd-4cda-b9d2-2e7fe9fb336b None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:29.280015 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:29.313867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b2800-6722-4990-82b3-e41908ea71a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:29.314461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b2800-6722-4990-82b3-e41908ea71a2 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:29.314731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b2800-6722-4990-82b3-e41908ea71a2 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:29.314994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b2800-6722-4990-82b3-e41908ea71a2 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:29.315619 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b2800-6722-4990-82b3-e41908ea71a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:29.317009 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b2800-6722-4990-82b3-e41908ea71a2 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:29.331282 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 387/764] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:40:29 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:30.531820 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f466-0c4e-4c22-b124-c8fc458053b9 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:30.532353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f466-0c4e-4c22-b124-c8fc458053b9 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:30.532496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f466-0c4e-4c22-b124-c8fc458053b9 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:30.534059 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 378/765] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:30.539521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba78c3-0148-4cbb-bead-7a1670a994d0 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:30.539919 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba78c3-0148-4cbb-bead-7a1670a994d0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:30.540080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba78c3-0148-4cbb-bead-7a1670a994d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:30.559166 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c7ba78c3-0148-4cbb-bead-7a1670a994d0 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:30.560342 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c7ba78c3-0148-4cbb-bead-7a1670a994d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:30.637566 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 388/766] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:30 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:30.960874 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f466-0c4e-4c22-b124-c8fc458053b9 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:30.972265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:31.068515 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f466-0c4e-4c22-b124-c8fc458053b9 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:31.104347 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:31.105001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:31.105273 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:31.105540 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:31.106118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:31.107485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:31.117446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:31.118485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:31.119469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 379/767] 10.222.0.59 () {56 vars in 1132 bytes} [Mon Aug 22 17:40:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:31.124545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba78c3-0148-4cbb-bead-7a1670a994d0 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:31.215942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:31.229573 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba78c3-0148-4cbb-bead-7a1670a994d0 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:31.263705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:31.264305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:31.264586 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:31.264875 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:31.265506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:31.265805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:31.267177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:31.274376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 389/768] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Aug 22 17:40:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:31.280237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:31.349146 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:31.382633 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984fe1-f623-4b03-b37f-30159066f216 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:31.419191 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7b54e-2665-46d8-9635-475fc013d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:31.419794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b54e-2665-46d8-9635-475fc013d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:31.420070 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b54e-2665-46d8-9635-475fc013d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:31.420323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b54e-2665-46d8-9635-475fc013d1b3 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:31.420987 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7b54e-2665-46d8-9635-475fc013d1b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:31.421282 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7b54e-2665-46d8-9635-475fc013d1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:31.422645 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7b54e-2665-46d8-9635-475fc013d1b3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:31.427417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 380/769] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Aug 22 17:40:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:31.433709 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:31.533221 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208fe0c-9334-4365-a794-2b8bf21afe9c None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:31.533815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208fe0c-9334-4365-a794-2b8bf21afe9c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:31.533815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208fe0c-9334-4365-a794-2b8bf21afe9c None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:31.535685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 381/770] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:31.537260 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b05f-0db0-48a2-81b6-270e15e36359 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:31.541889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4cd5-f094-42c2-bb86-e9c592efe4ec None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:31.542171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4cd5-f094-42c2-bb86-e9c592efe4ec None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:31.542443 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4cd5-f094-42c2-bb86-e9c592efe4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:31.561279 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-db1c4cd5-f094-42c2-bb86-e9c592efe4ec None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:31.562451 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-db1c4cd5-f094-42c2-bb86-e9c592efe4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:31.576128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:31.576761 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:31.577318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:31.577318 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:31.577980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] RBAC: Adding query filter params (interface=public, service_id=23343f285baa4475a6046748f32f9c90, region_id=RegionOne) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:31.578288 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:31.579734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:31.584940 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 390/771] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Aug 22 17:40:31 2022] GET /identity/v3/endpoints?service_id=23343f285baa4475a6046748f32f9c90&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:31.590517 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:31.607972 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:31.631242 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 382/772] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:31.688919 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c129d-bdcb-4e5a-be36-d63a5e0b0b8f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:31.723144 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:31.723747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:31.724017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:31.724278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:31.724914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:31.726430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:31.732146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 391/773] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Aug 22 17:40:31 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:40:31.957888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4cd5-f094-42c2-bb86-e9c592efe4ec None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:32.024146 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:32.058312 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4cd5-f094-42c2-bb86-e9c592efe4ec None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:32.092566 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:32.093223 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:32.093496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:32.093762 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:32.094340 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:32.095718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:32.104384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:32.105415 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:32.106255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 383/774] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:32.111739 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:32.199499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:32.219916 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a353-b73c-461f-85d2-36af421dfb44 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:32.254168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:32.254776 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:32.255047 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:32.255312 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:32.255935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:32.256230 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:32.257769 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:32.262529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 392/775] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:32.268272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:32.377787 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5621f7-bcb5-4af6-975d-6fff3821b78d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:32.405634 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:32.411832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:32.412433 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:32.412741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:32.413012 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:32.413670 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:32.413991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:32.415361 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:32.420392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 384/776] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:32.426400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:32.525493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45bdc-56c3-46a8-909a-f9e3177e981f None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:32.560213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad7a9-8398-4019-af36-2e13a6e1ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:32.560842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad7a9-8398-4019-af36-2e13a6e1ae99 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:32.561115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad7a9-8398-4019-af36-2e13a6e1ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:32.561376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad7a9-8398-4019-af36-2e13a6e1ae99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:32.562072 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ad7a9-8398-4019-af36-2e13a6e1ae99 None admin] RBAC: Adding query filter params (interface=public, service_id=3ddf1d51f9d74b94bf5457716c5c23c4, region_id=RegionOne) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:32.562374 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ad7a9-8398-4019-af36-2e13a6e1ae99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:32.564103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ad7a9-8398-4019-af36-2e13a6e1ae99 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:32.569338 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 393/777] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Aug 22 17:40:32 2022] GET /identity/v3/endpoints?service_id=3ddf1d51f9d74b94bf5457716c5c23c4&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:32.575210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:32.673710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050c9c-0d83-4acf-adb1-14a157e9dedd None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:32.708010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9db4a-70b1-4182-996e-9dc053e8256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:32.708585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9db4a-70b1-4182-996e-9dc053e8256b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:32.708923 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9db4a-70b1-4182-996e-9dc053e8256b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:32.709190 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9db4a-70b1-4182-996e-9dc053e8256b None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:32.709793 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9db4a-70b1-4182-996e-9dc053e8256b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:32.711269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9db4a-70b1-4182-996e-9dc053e8256b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:32.717480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 385/778] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Aug 22 17:40:32 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:40:33.916915 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3586-f2d5-4310-8cbd-6bf8e00dece0 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:33.917539 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3586-f2d5-4310-8cbd-6bf8e00dece0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:33.917539 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3586-f2d5-4310-8cbd-6bf8e00dece0 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:33.919213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 394/779] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:33.924800 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2402a-826f-42df-8fa6-6c0cd072d648 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:33.925275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2402a-826f-42df-8fa6-6c0cd072d648 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:33.925374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2402a-826f-42df-8fa6-6c0cd072d648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:33.946102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-efe2402a-826f-42df-8fa6-6c0cd072d648 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:33.947303 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-efe2402a-826f-42df-8fa6-6c0cd072d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:34.003241 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:34.017511 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 386/780] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:34.338044 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d3586-f2d5-4310-8cbd-6bf8e00dece0 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:34.349884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:34.445862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d3586-f2d5-4310-8cbd-6bf8e00dece0 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:34.480321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:34.480993 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:34.481269 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:34.481532 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:34.482111 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:34.483491 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:34.493061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:34.494069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:34.495068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 395/781] 10.222.0.59 () {56 vars in 1132 bytes} [Mon Aug 22 17:40:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:34.500254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2402a-826f-42df-8fa6-6c0cd072d648 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:34.607344 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2402a-826f-42df-8fa6-6c0cd072d648 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:34.642020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:34.642619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:34.642895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:34.643163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:34.643792 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:34.644093 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:34.645512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:34.650494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 387/782] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Aug 22 17:40:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:34.656605 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:34.732392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:34.766239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775cd3-57f9-4f9f-bf64-812f028588b3 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:34.801892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a722-3b42-4a32-8171-ed328ae1eb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:34.802492 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a722-3b42-4a32-8171-ed328ae1eb93 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:34.802760 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a722-3b42-4a32-8171-ed328ae1eb93 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:34.803022 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a722-3b42-4a32-8171-ed328ae1eb93 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:34.803642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a722-3b42-4a32-8171-ed328ae1eb93 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:34.803989 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a722-3b42-4a32-8171-ed328ae1eb93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:34.805387 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a722-3b42-4a32-8171-ed328ae1eb93 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:34.810998 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 396/783] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Aug 22 17:40:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:34.818146 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:34.872196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:34.885506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b9675-ffc0-410c-96f3-3936ac9aa71b None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:34.885798 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b9675-ffc0-410c-96f3-3936ac9aa71b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:34.886041 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b9675-ffc0-410c-96f3-3936ac9aa71b None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:34.887376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 397/784] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:40:34.892704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5cda-b487-4b79-a357-1aca633b0fe5 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:34.892997 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5cda-b487-4b79-a357-1aca633b0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:34.893262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5cda-b487-4b79-a357-1aca633b0fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:34.911536 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-5ebe5cda-b487-4b79-a357-1aca633b0fe5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:34.912788 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-5ebe5cda-b487-4b79-a357-1aca633b0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:34.921144 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091878-c3be-42ef-8ee8-1c039082df2a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:34.957964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:34.958919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:34.958919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:34.959236 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:34.959738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:34.961436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:34.984675 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 388/785] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:40:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:40:34.991813 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 398/786] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:34 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:40:35.321981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:35.430224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bc2f2-474a-4993-a702-b089c12b8d18 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:35.439650 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:35.466777 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:35.467407 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:35.467683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:35.467945 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:35.468520 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:35.469918 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:35.478840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:35.479833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:35.480685 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 389/787] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:35.486335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe5cda-b487-4b79-a357-1aca633b0fe5 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:35.548526 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:35.589242 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe5cda-b487-4b79-a357-1aca633b0fe5 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:35.624247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:35.624892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:35.625171 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:35.625440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:35.626057 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:35.626459 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:35.627842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:35.632962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 399/788] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:35.638927 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:35.748674 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7ca97-83ee-4273-a4cf-b28f32c2cd59 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:35.783705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa85b06-53ba-464a-9131-1d394a43d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:35.784307 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85b06-53ba-464a-9131-1d394a43d535 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:35.784586 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85b06-53ba-464a-9131-1d394a43d535 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:35.784889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85b06-53ba-464a-9131-1d394a43d535 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:35.785518 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa85b06-53ba-464a-9131-1d394a43d535 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:35.785817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa85b06-53ba-464a-9131-1d394a43d535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:35.787185 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa85b06-53ba-464a-9131-1d394a43d535 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:35.792957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 390/789] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Aug 22 17:40:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:35.799077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:35.903239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d085e0-2381-45ff-a835-7395cfdf37a4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:35.928872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:35.937900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2554b0e-48d9-4793-ab08-8e6f957936ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:35.938501 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554b0e-48d9-4793-ab08-8e6f957936ec None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:35.938771 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554b0e-48d9-4793-ab08-8e6f957936ec None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:35.939032 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554b0e-48d9-4793-ab08-8e6f957936ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:35.939686 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2554b0e-48d9-4793-ab08-8e6f957936ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:35.941073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2554b0e-48d9-4793-ab08-8e6f957936ec None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:35.961188 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 400/790] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:40:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:40:37.221768 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6970e-5271-4126-9a56-19b23ed5dc60 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:37.222333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6970e-5271-4126-9a56-19b23ed5dc60 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:37.222333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6970e-5271-4126-9a56-19b23ed5dc60 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:37.223672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 391/791] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:37.229601 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d82f6-73f2-44d3-bec4-1773b32bc2e0 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:37.230061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d82f6-73f2-44d3-bec4-1773b32bc2e0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:37.230197 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d82f6-73f2-44d3-bec4-1773b32bc2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:37.248889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-9a1d82f6-73f2-44d3-bec4-1773b32bc2e0 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:37.250090 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-9a1d82f6-73f2-44d3-bec4-1773b32bc2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:37.329538 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 401/792] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:37 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:40:37.652297 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6970e-5271-4126-9a56-19b23ed5dc60 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:37.692304 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:37.759153 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6970e-5271-4126-9a56-19b23ed5dc60 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:37.794477 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:37.795123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:37.795394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:37.795658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] PATH_INFO: `/v3/services/compute` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:37.796251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:37.797702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:37.806981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:37.808031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:37.809376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 392/793] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:37.814567 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d82f6-73f2-44d3-bec4-1773b32bc2e0 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:37.916418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d82f6-73f2-44d3-bec4-1773b32bc2e0 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:37.925935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:37.954643 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d0db8-2029-40ec-acbb-71a002430d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:37.955291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0db8-2029-40ec-acbb-71a002430d11 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:37.955583 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0db8-2029-40ec-acbb-71a002430d11 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:37.955845 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0db8-2029-40ec-acbb-71a002430d11 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:37.956499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d0db8-2029-40ec-acbb-71a002430d11 None admin] RBAC: Adding query filter params (name=compute) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:37.956843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d0db8-2029-40ec-acbb-71a002430d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:37.958246 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d0db8-2029-40ec-acbb-71a002430d11 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:37.963198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 402/794] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:37.969200 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:38.078063 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:38.081772 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d77cd-1dcd-4386-b566-3409d05c3622 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:38.118869 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64584aad-cc61-43b0-b6fb-d11aaed25f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:38.119479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584aad-cc61-43b0-b6fb-d11aaed25f97 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:38.119757 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584aad-cc61-43b0-b6fb-d11aaed25f97 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:38.120026 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584aad-cc61-43b0-b6fb-d11aaed25f97 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:38.120687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64584aad-cc61-43b0-b6fb-d11aaed25f97 None admin] RBAC: Adding query filter params (type=compute) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:38.120990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64584aad-cc61-43b0-b6fb-d11aaed25f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:38.122425 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64584aad-cc61-43b0-b6fb-d11aaed25f97 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:38.127040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 393/795] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:38.155800 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194f26-4c62-4061-a660-bec803f7dd8e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:38.156197 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194f26-4c62-4061-a660-bec803f7dd8e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:38.156543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194f26-4c62-4061-a660-bec803f7dd8e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:38.158650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 403/796] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:38.164734 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2e0a-d82c-4f0a-8854-7b057e4a0af7 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:38.165043 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2e0a-d82c-4f0a-8854-7b057e4a0af7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:38.165274 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2e0a-d82c-4f0a-8854-7b057e4a0af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:38.184207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-204c2e0a-d82c-4f0a-8854-7b057e4a0af7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:38.185359 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-204c2e0a-d82c-4f0a-8854-7b057e4a0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:38.261380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 394/797] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:40:38.581756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194f26-4c62-4061-a660-bec803f7dd8e None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:38.687573 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194f26-4c62-4061-a660-bec803f7dd8e None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:38.722470 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:38.723066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:38.723337 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:38.723597 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:38.724247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:38.725833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:38.728423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING keystone.server.flask.common [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 17:40:38.746924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.sql.core [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 17:40:38.746924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 17:40:38.746924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [parameters: {'id': 'f5bfb9bcd1404b5a88ebefd60c095a20', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 17:40:38.746924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=100233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5bfb9bcd1404b5a88ebefd60c095a20.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5bfb9bcd1404b5a88ebefd60c095a20. Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application conn.query(q) Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:40:38.763608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result.read() Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 17:40:38.764438 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application next(self.gen) Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application yield resource Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application next(self.gen) Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise self.value Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application session.commit() Aug 22 17:40:38.765647 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.session.flush() Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application compat.raise_( Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 17:40:38.766754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 17:40:38.767711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application conn.query(q) Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result.read() Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:40:38.768545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [parameters: {'id': 'f5bfb9bcd1404b5a88ebefd60c095a20', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:38.769500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:38.771496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5bfb9bcd1404b5a88ebefd60c095a20. Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:38.773588 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 404/798] 10.222.0.59 () {60 vars in 1140 bytes} [Mon Aug 22 17:40:38 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:38.774788 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2e0a-d82c-4f0a-8854-7b057e4a0af7 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:38.865475 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:38.872631 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2e0a-d82c-4f0a-8854-7b057e4a0af7 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:38.906069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d055cb0-c185-4599-af5c-5766b19e7ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:38.906719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055cb0-c185-4599-af5c-5766b19e7ae6 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:38.906990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055cb0-c185-4599-af5c-5766b19e7ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:38.907252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055cb0-c185-4599-af5c-5766b19e7ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:38.913895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d055cb0-c185-4599-af5c-5766b19e7ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:38.915323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d055cb0-c185-4599-af5c-5766b19e7ae6 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-1d055cb0-c185-4599-af5c-5766b19e7ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:40:38.926346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:38.927270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:38.928208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 395/799] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:38.933973 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:38.964572 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:39.040748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510afea-e91f-474d-8225-7d1f8c2b93d9 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:39.076354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b590-33df-4161-bfc5-080f3c496590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:39.076997 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b590-33df-4161-bfc5-080f3c496590 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:39.077268 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b590-33df-4161-bfc5-080f3c496590 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:39.077533 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b590-33df-4161-bfc5-080f3c496590 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:39.078191 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b590-33df-4161-bfc5-080f3c496590 None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:39.078488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b590-33df-4161-bfc5-080f3c496590 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:39.080121 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b590-33df-4161-bfc5-080f3c496590 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:39.100198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 405/800] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:40.387602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb9ce-679d-447a-b8b2-f6e47e0d598d None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:40.388145 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb9ce-679d-447a-b8b2-f6e47e0d598d None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:40.388145 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb9ce-679d-447a-b8b2-f6e47e0d598d None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:40.389490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 396/801] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:40.395298 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ec02-340f-48df-a19d-ddd26de687b6 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:40.395773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ec02-340f-48df-a19d-ddd26de687b6 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:40.395873 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ec02-340f-48df-a19d-ddd26de687b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:40.417814 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-4b02ec02-340f-48df-a19d-ddd26de687b6 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:40.419353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4b02ec02-340f-48df-a19d-ddd26de687b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:40.498286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 406/802] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:40.832340 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb9ce-679d-447a-b8b2-f6e47e0d598d None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:40.960405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb9ce-679d-447a-b8b2-f6e47e0d598d None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:40.994108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59e3e-6cfb-4146-879b-5a1df5141e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:40.994744 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59e3e-6cfb-4146-879b-5a1df5141e0a None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:40.995021 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59e3e-6cfb-4146-879b-5a1df5141e0a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:40.995286 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59e3e-6cfb-4146-879b-5a1df5141e0a None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:40.995936 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df59e3e-6cfb-4146-879b-5a1df5141e0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:40.997351 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df59e3e-6cfb-4146-879b-5a1df5141e0a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:41.012898 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 397/803] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:40:40 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:41.417201 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19667f-98a0-45cb-98b0-60b8cdd059ce None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:41.417772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19667f-98a0-45cb-98b0-60b8cdd059ce None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:41.417772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19667f-98a0-45cb-98b0-60b8cdd059ce None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:41.419083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 407/804] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:41.424531 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67610397-6255-4776-a0d8-38dcd7c543cd None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:41.425044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67610397-6255-4776-a0d8-38dcd7c543cd None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:41.425169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67610397-6255-4776-a0d8-38dcd7c543cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:41.444095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-67610397-6255-4776-a0d8-38dcd7c543cd None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:41.445611 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-67610397-6255-4776-a0d8-38dcd7c543cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:41.455064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:41.518055 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 398/805] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:41 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:41.849452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19667f-98a0-45cb-98b0-60b8cdd059ce None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:41.870991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:41.959046 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19667f-98a0-45cb-98b0-60b8cdd059ce None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:42.003556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:42.004163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:42.004433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:42.004731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:42.005369 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:42.007016 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:42.022208 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.sql.core [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 17:40:42.022208 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 17:40:42.022208 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [parameters: {'user_id': '544e0d97e6314ffda33e1ebdb406b4bb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 17:40:42.022208 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=100233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application conn.query(q) Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result.read() Aug 22 17:40:42.028513 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 17:40:42.029488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application next(self.gen) Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application yield resource Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application next(self.gen) Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise self.value Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application session.commit() Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 17:40:42.030448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.session.flush() Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application compat.raise_( Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 17:40:42.031320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:40:42.032226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application conn.query(q) Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application result.read() Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:40:42.033119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [parameters: {'user_id': '544e0d97e6314ffda33e1ebdb406b4bb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:42.033933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 17:40:42.034699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 17:40:42.035645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 17:40:42.035645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 17:40:42.035645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 17:40:42.035645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 17:40:42.035645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 17:40:42.035645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:42.035645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 408/806] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Aug 22 17:40:41 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:42.039330 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67610397-6255-4776-a0d8-38dcd7c543cd None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:42.150108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67610397-6255-4776-a0d8-38dcd7c543cd None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:42.185692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc5064-25f8-4637-ab45-07e85f1acf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:42.186319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5064-25f8-4637-ab45-07e85f1acf81 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:42.186592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5064-25f8-4637-ab45-07e85f1acf81 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:42.186853 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5064-25f8-4637-ab45-07e85f1acf81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:42.194916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc5064-25f8-4637-ab45-07e85f1acf81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:42.196643 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc5064-25f8-4637-ab45-07e85f1acf81 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:42.199421 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-f9fc5064-25f8-4637-ab45-07e85f1acf81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:40:42.209288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:42.210585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:42.211519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 399/807] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:40:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:42.216811 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:42.301798 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:42.323242 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce86f3-612d-475f-bb50-bee63f1868c4 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:42.359345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5c627-e026-4f91-8a3e-cddfce5928c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:42.359951 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5c627-e026-4f91-8a3e-cddfce5928c8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:42.360224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5c627-e026-4f91-8a3e-cddfce5928c8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:42.360486 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5c627-e026-4f91-8a3e-cddfce5928c8 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:42.361214 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5c627-e026-4f91-8a3e-cddfce5928c8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:42.361510 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5c627-e026-4f91-8a3e-cddfce5928c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:42.363266 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5c627-e026-4f91-8a3e-cddfce5928c8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:42.401067 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 409/808] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Aug 22 17:40:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:43.223194 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98aa9a-5f63-4b24-811a-4bb7c6ff6f89 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:43.223727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98aa9a-5f63-4b24-811a-4bb7c6ff6f89 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:43.223727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98aa9a-5f63-4b24-811a-4bb7c6ff6f89 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:43.225156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 400/809] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:43.231896 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691fec-1a28-4146-859e-60f2e62aa0a9 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:43.232685 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691fec-1a28-4146-859e-60f2e62aa0a9 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:43.232815 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691fec-1a28-4146-859e-60f2e62aa0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:43.256569 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-73691fec-1a28-4146-859e-60f2e62aa0a9 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:43.258259 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-73691fec-1a28-4146-859e-60f2e62aa0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:43.332127 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 410/810] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:43 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:43.653626 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98aa9a-5f63-4b24-811a-4bb7c6ff6f89 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:43.763610 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98aa9a-5f63-4b24-811a-4bb7c6ff6f89 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:43.799023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:43.799634 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:43.799903 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:43.800175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:43.800775 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:43.802142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:43.810990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:43.812086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:40:43.813653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 401/811] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:43.821121 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73691fec-1a28-4146-859e-60f2e62aa0a9 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:43.900489 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:43.951670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73691fec-1a28-4146-859e-60f2e62aa0a9 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:43.988519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:43.989180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:43.989458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:43.989721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:43.990376 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] RBAC: Adding query filter params (name=compute) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:43.990681 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:43.993979 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:44.001693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 411/812] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:44.008572 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:44.079697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:44.125194 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a4519-dd19-4db6-b589-2b470012cef6 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:44.162991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:44.163652 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:44.164028 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:44.164299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:44.164970 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] RBAC: Adding query filter params (type=compute) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:44.165269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:44.166639 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:44.171485 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 402/813] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:44.178216 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:44.316996 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c28e-cc27-4c70-a8ca-52d52b5e8c5e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:44.352415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:44.358819 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571641ca-2f0c-4894-a207-09a56f855cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:44.359448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571641ca-2f0c-4894-a207-09a56f855cd8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:44.359725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571641ca-2f0c-4894-a207-09a56f855cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:44.359979 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571641ca-2f0c-4894-a207-09a56f855cd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:44.360709 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571641ca-2f0c-4894-a207-09a56f855cd8 None admin] RBAC: Adding query filter params (interface=public, service_id=ea0594aa7bbc4291aad5cd23c3845394, region_id=RegionOne) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:44.361018 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571641ca-2f0c-4894-a207-09a56f855cd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:44.362400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571641ca-2f0c-4894-a207-09a56f855cd8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:44.368730 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 412/814] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Aug 22 17:40:44 2022] GET /identity/v3/endpoints?service_id=ea0594aa7bbc4291aad5cd23c3845394&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:44.375277 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:44.489646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8d79-4108-4a82-be30-b072ca100a89 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:44.516600 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:44.527638 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833cab9-0495-429c-a0cd-008dc247f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:44.528244 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833cab9-0495-429c-a0cd-008dc247f976 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:44.528520 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833cab9-0495-429c-a0cd-008dc247f976 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:44.528822 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833cab9-0495-429c-a0cd-008dc247f976 None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:44.529450 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833cab9-0495-429c-a0cd-008dc247f976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:44.530844 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833cab9-0495-429c-a0cd-008dc247f976 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:44.537103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 403/815] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Aug 22 17:40:44 2022] GET /identity/v3/services => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:40:46.714347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4590422-7ab4-4b08-af54-7ebd7be05f02 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:46.714952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4590422-7ab4-4b08-af54-7ebd7be05f02 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:46.714952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4590422-7ab4-4b08-af54-7ebd7be05f02 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:46.717047 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 413/816] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:40:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:40:46.726523 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b705-29dc-43b9-95cc-037bcbeb2aa6 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:46.726914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b705-29dc-43b9-95cc-037bcbeb2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:46.727265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b705-29dc-43b9-95cc-037bcbeb2aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:46.751930 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-3472b705-29dc-43b9-95cc-037bcbeb2aa6 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:40:46.753146 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-3472b705-29dc-43b9-95cc-037bcbeb2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:40:46.824627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 404/817] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:40:46 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:40:47.153557 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4590422-7ab4-4b08-af54-7ebd7be05f02 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:47.289353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4590422-7ab4-4b08-af54-7ebd7be05f02 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:47.327062 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:47.327696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:47.327972 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:47.328238 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:47.328852 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:47.330222 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:40:47.339328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:40:47.340540 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:40:47.341705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 414/818] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:40:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:40:47.347338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b705-29dc-43b9-95cc-037bcbeb2aa6 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:47.455182 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b705-29dc-43b9-95cc-037bcbeb2aa6 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:47.478463 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:47.491137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:47.491833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:47.492171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:47.492381 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:47.493048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:47.493330 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:47.494732 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:47.499498 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 405/819] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:47.505563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:47.568463 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:47.616946 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c723784-230e-443b-8b6d-1bc6e7cf16c7 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:47.656090 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92141801-603c-42b2-97af-666b55638fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:47.657117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141801-603c-42b2-97af-666b55638fdb None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:47.657543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141801-603c-42b2-97af-666b55638fdb None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:47.657950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141801-603c-42b2-97af-666b55638fdb None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:47.659013 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92141801-603c-42b2-97af-666b55638fdb None admin] RBAC: Adding query filter params (type=compute) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:40:47.659489 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92141801-603c-42b2-97af-666b55638fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:47.661775 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92141801-603c-42b2-97af-666b55638fdb None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:47.670074 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 415/820] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Aug 22 17:40:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:40:47.676946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:40:47.786094 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b2f5-136b-4c6f-ac77-5509ca7fbf4c None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:40:47.821593 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ece6a-7375-42ad-9468-057c71219700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:40:47.822182 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ece6a-7375-42ad-9468-057c71219700 None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:40:47.822461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ece6a-7375-42ad-9468-057c71219700 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:40:47.822728 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ece6a-7375-42ad-9468-057c71219700 None admin] PATH_INFO: `/v3/endpoints` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:40:47.823394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ece6a-7375-42ad-9468-057c71219700 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:40:47.824833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ece6a-7375-42ad-9468-057c71219700 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:40:47.851408 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 406/821] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:40:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:40:57.665509 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=38 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:57.844045 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=78,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:51.129856 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257a47c-684b-4428-9afa-c3a51480210a None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:51.130548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257a47c-684b-4428-9afa-c3a51480210a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:51.130665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257a47c-684b-4428-9afa-c3a51480210a None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:51.132365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 416/822] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:41:51.138322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320268b-1920-4abd-9594-56188e4a3999 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:51.138799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320268b-1920-4abd-9594-56188e4a3999 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:51.138897 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320268b-1920-4abd-9594-56188e4a3999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:51.160436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-7320268b-1920-4abd-9594-56188e4a3999 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:41:51.162013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-7320268b-1920-4abd-9594-56188e4a3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:41:51.258763 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 407/823] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:41:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:41:51.600979 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257a47c-684b-4428-9afa-c3a51480210a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:51.733726 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257a47c-684b-4428-9afa-c3a51480210a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:51.772798 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:51.773435 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:51.773712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:51.773978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:51.785691 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:51.787134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:41:51.803791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:41:51.805627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:41:51.807236 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:41:51.807236 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:41:51.807236 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:41:51.807236 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 417/824] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:41:51.812491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320268b-1920-4abd-9594-56188e4a3999 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:51.925026 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320268b-1920-4abd-9594-56188e4a3999 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:51.957846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:51.970784 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2c041-bc67-460a-9e84-0dffd75a79d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:51.971902 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2c041-bc67-460a-9e84-0dffd75a79d1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:51.972172 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2c041-bc67-460a-9e84-0dffd75a79d1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:51.972508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2c041-bc67-460a-9e84-0dffd75a79d1 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:51.973250 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2c041-bc67-460a-9e84-0dffd75a79d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:41:51.973592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2c041-bc67-460a-9e84-0dffd75a79d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:51.975301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2c041-bc67-460a-9e84-0dffd75a79d1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:51.994666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 408/825] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:41:51.995876 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:52.067328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:52.127155 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cd8b8-5b92-43de-aae6-ad00f2a5faaf None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:52.168503 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af691e22-5175-4975-a76d-219961beda83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:52.172768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691e22-5175-4975-a76d-219961beda83 None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:52.172768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691e22-5175-4975-a76d-219961beda83 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:52.172768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691e22-5175-4975-a76d-219961beda83 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:52.172768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af691e22-5175-4975-a76d-219961beda83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:52.172768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af691e22-5175-4975-a76d-219961beda83 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:52.199223 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 418/826] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Aug 22 17:41:51 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:41:54.490513 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19216ea-17f7-4ee1-973c-32650d1a0991 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:54.491167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19216ea-17f7-4ee1-973c-32650d1a0991 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:54.491167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19216ea-17f7-4ee1-973c-32650d1a0991 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:54.492562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 409/827] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:41:54.498239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7407f7-d88c-4651-8fb7-604f48a5c99e None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:54.498781 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7407f7-d88c-4651-8fb7-604f48a5c99e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:54.498781 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7407f7-d88c-4651-8fb7-604f48a5c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:54.518238 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-dc7407f7-d88c-4651-8fb7-604f48a5c99e None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:41:54.519461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-dc7407f7-d88c-4651-8fb7-604f48a5c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:41:54.594284 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 419/828] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:41:54 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:41:54.956112 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19216ea-17f7-4ee1-973c-32650d1a0991 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:55.070508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19216ea-17f7-4ee1-973c-32650d1a0991 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:55.107411 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:55.108057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:55.108332 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:55.108626 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:55.120877 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:41:55.125821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:41:55.127071 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:41:55.128494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 410/829] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:41:55.133275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7407f7-d88c-4651-8fb7-604f48a5c99e None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:55.181974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:55.253347 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7407f7-d88c-4651-8fb7-604f48a5c99e None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:55.291832 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:55.292494 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:55.292851 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:55.293122 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:55.293884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:41:55.294224 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:55.295729 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:55.305093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 420/830] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:41:55.311129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:55.362513 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:55.420770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33327532-c5a8-4e19-99a5-13271622f1dd None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:55.455737 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:55.456365 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:55.456664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:55.456932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:55.468713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:55.470556 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:41:55.490550 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:41:55.492159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:41:55.493171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:41:55.493171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:41:55.493171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:41:55.493171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 411/831] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:41:55.499206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:55.606804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:55.610357 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a486-6dc1-4027-bc59-b22702fbb661 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:55.647674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:55.648363 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:55.648727 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:55.648996 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:55.649731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:41:55.650106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:55.651592 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:55.666220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 421/832] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:41:55.672177 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:55.777646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:55.781470 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b221bf-b621-435f-9b06-e623acb2601b None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:55.820588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:55.821487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:55.821713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:55.821996 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:55.830990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:55.832546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:41:55.844589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:41:55.850476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:41:55.851644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 412/833] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:41:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:41:55.852561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:55.963375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e4156-c3a7-46b8-a47a-6e16a5320d15 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:55.999635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:56.000286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:56.000561 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:56.000946 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:56.001779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:41:56.002133 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:56.003878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:56.023632 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 422/834] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Aug 22 17:41:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:41:56.030432 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:56.142079 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82960d-2119-4fb4-b468-690bd9defae1 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:56.179413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:56.180049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:56.180516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:56.180666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:56.221547 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:56.271298 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:56.272820 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:56.379621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 413/835] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:41:56 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:41:56.385936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:56.411881 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:56.508356 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891ca97-f4da-439d-b269-83bb9ad078db None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:56.545931 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:56.546615 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:56.546817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:56.547218 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:56.558375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:56.559929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:41:56.575215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:41:56.576472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:41:56.582911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:41:56.582911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:41:56.582911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:41:56.582911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 423/836] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:41:56.583205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:56.644220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:56.688309 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9faaf-5ac1-425d-ac8a-df38ecd94b58 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:56.724343 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:56.724987 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:56.725283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:56.725542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:56.726172 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:41:56.726466 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:56.727839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:56.739794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 414/837] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:41:56.745744 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:56.833383 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:56.868582 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eb128-1e67-4798-8ab2-81d56b5f56f9 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:56.906562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:56.907187 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:56.907461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:56.907843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:56.915019 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:56.916472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:41:56.927999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:41:56.928984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:41:56.929872 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 424/838] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:41:56.936113 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:57.044092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6c1c-8138-4387-aa86-6dc127e1f39d None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:57.061156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:57.079752 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08272b6-8326-43a8-b12b-7398bf312f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:57.080363 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08272b6-8326-43a8-b12b-7398bf312f9e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:57.080668 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08272b6-8326-43a8-b12b-7398bf312f9e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:57.080940 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08272b6-8326-43a8-b12b-7398bf312f9e None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:57.081624 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08272b6-8326-43a8-b12b-7398bf312f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:41:57.081924 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08272b6-8326-43a8-b12b-7398bf312f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:57.083345 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08272b6-8326-43a8-b12b-7398bf312f9e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:57.096256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 415/839] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:41:57.104397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:41:57.222130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94813ab1-c5af-4434-b597-d8f71f96f6c2 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:41:57.256081 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:57.264902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0f4d5-259a-4d03-b182-7f2a6d8d8b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:41:57.265515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f4d5-259a-4d03-b182-7f2a6d8d8b6b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:57.265788 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f4d5-259a-4d03-b182-7f2a6d8d8b6b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:57.266053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f4d5-259a-4d03-b182-7f2a6d8d8b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:57.266768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0f4d5-259a-4d03-b182-7f2a6d8d8b6b None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=cd40f73d7b494ef1ba7e17bdb202ccee) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:41:57.267062 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0f4d5-259a-4d03-b182-7f2a6d8d8b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:41:57.268533 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0f4d5-259a-4d03-b182-7f2a6d8d8b6b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:41:57.274576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 425/840] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:41:57 2022] GET /identity/v3/role_assignments?user.id=cd40f73d7b494ef1ba7e17bdb202ccee&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:41:59.690168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204ceb-c392-4b13-90aa-2d127da8986f None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:59.691081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204ceb-c392-4b13-90aa-2d127da8986f None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:59.691081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204ceb-c392-4b13-90aa-2d127da8986f None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:59.693035 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 416/841] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:41:59.698307 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b24a-dae7-4b66-bbf9-01097799398d None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:41:59.698759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b24a-dae7-4b66-bbf9-01097799398d None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:41:59.698853 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b24a-dae7-4b66-bbf9-01097799398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:41:59.717738 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-5fe0b24a-dae7-4b66-bbf9-01097799398d None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:41:59.718938 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-5fe0b24a-dae7-4b66-bbf9-01097799398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:41:59.793338 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 426/842] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:41:59 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:00.172845 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc204ceb-c392-4b13-90aa-2d127da8986f None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:00.301971 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc204ceb-c392-4b13-90aa-2d127da8986f None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:00.342820 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:00.343468 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:00.343746 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:00.344023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:00.357092 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:42:00.361873 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:00.363123 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:00.364115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 417/843] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:00.369277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0b24a-dae7-4b66-bbf9-01097799398d None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:00.483571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0b24a-dae7-4b66-bbf9-01097799398d None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:00.508684 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:00.523069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:00.523686 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:00.523961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:00.524231 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:00.524927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] RBAC: Adding query filter params (name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:00.525226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:00.526701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:00.535924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 427/844] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:42:00.541950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:00.583644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:00.649353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc53e6f-60e0-4685-bd8e-9372f6aaa3a9 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:00.686295 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:00.686990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:00.687268 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:00.687537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:00.699338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:00.701304 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:00.716392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:00.717627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:00.719060 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:00.719060 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:00.719060 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:00.719060 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 418/845] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:00.723972 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:00.849753 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55826497-41ca-4521-842b-0fea838c6344 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:00.886247 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:00.887059 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:00.887439 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:00.887810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:00.888748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:00.889131 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:00.890801 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:00.907086 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 428/846] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:00.915624 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:01.021745 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.032764 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb7ce4-54b5-4302-80df-ac661ca49f6b None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:01.070846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:01.071696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:01.072076 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:01.072507 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:01.082195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:01.083636 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:42:01.095480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:01.096666 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:01.097913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 419/847] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:01.102627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:01.150743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.207264 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f5eb-1620-40d9-853a-1c5e19e67f6b None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:01.244670 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:01.245354 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:01.245687 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:01.245957 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:01.246823 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:01.247326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:01.249904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:01.270932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 429/848] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Aug 22 17:42:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:01.278145 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:01.393314 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf876d5f-cd13-423a-a902-669b35700033 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:01.438823 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:01.439453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:01.439736 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:01.440000 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:01.451490 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:01.453057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:01.469233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:01.470392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:01.471632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:01.471632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:01.471632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:01.471632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 420/849] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:01.476434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:01.584205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b5319-b526-4c8e-9ee2-392298cd01d2 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:01.586713 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.622688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:01.623522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:01.623795 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:01.624058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:01.624753 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:01.625049 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:01.626413 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:01.638083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 430/850] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:01.644334 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:01.647533 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.752258 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502edaa3-629a-4005-986a-1f44c2ae17cb None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:01.785491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:01.786110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:01.786387 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:01.786655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:01.793322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:01.795569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:42:01.806671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:01.807804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:01.808958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 421/851] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:01.814810 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:01.937220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f297359-862b-4687-ae16-35d24cee9202 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:01.978605 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f3d4f-2a41-4c47-a73f-308d680180e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:01.979226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3d4f-2a41-4c47-a73f-308d680180e8 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:01.979505 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3d4f-2a41-4c47-a73f-308d680180e8 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:01.979777 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3d4f-2a41-4c47-a73f-308d680180e8 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:01.980469 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f3d4f-2a41-4c47-a73f-308d680180e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:01.980809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f3d4f-2a41-4c47-a73f-308d680180e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:01.982558 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f3d4f-2a41-4c47-a73f-308d680180e8 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:01.996977 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 431/852] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:02.003853 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:02.072824 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:02.117322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7e91-9102-449e-b56e-a74a53643396 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:02.157464 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6389-cf03-4e3b-ab18-85ef634824de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:02.158491 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6389-cf03-4e3b-ab18-85ef634824de None admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:02.158843 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6389-cf03-4e3b-ab18-85ef634824de None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:02.159137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6389-cf03-4e3b-ab18-85ef634824de None admin] PATH_INFO: `/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/cd40f73d7b494ef1ba7e17bdb202ccee/roles/694a30076f6245a7bc4ed75fa9ef9818` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:02.177348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6389-cf03-4e3b-ab18-85ef634824de None admin] RBAC: Authorizing `identity:create_grant(project_id=cb47a6c68ef54e3d97e6df4288eaf596, user_id=cd40f73d7b494ef1ba7e17bdb202ccee, role_id=694a30076f6245a7bc4ed75fa9ef9818)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:02.179132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6389-cf03-4e3b-ab18-85ef634824de None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:02.194117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 422/853] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:42:02 2022] PUT /identity/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/cd40f73d7b494ef1ba7e17bdb202ccee/roles/694a30076f6245a7bc4ed75fa9ef9818 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:42:04.545485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c02a-a581-464d-a47c-b668bf8116b5 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:04.546098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c02a-a581-464d-a47c-b668bf8116b5 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:04.546098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c02a-a581-464d-a47c-b668bf8116b5 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:04.547558 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 432/854] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:04.557299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12275e-8006-4c5a-94cb-3af5d7cf5142 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:04.557824 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12275e-8006-4c5a-94cb-3af5d7cf5142 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:04.558000 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12275e-8006-4c5a-94cb-3af5d7cf5142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:04.577169 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-ea12275e-8006-4c5a-94cb-3af5d7cf5142 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:04.578365 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-ea12275e-8006-4c5a-94cb-3af5d7cf5142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:04.650783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 423/855] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:04 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:04.986298 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6c02a-a581-464d-a47c-b668bf8116b5 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:05.015932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:05.115690 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6c02a-a581-464d-a47c-b668bf8116b5 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:05.152162 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:05.152885 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:05.153332 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:05.153729 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:05.165612 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:42:05.171361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:05.172409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:05.173392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 433/856] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Aug 22 17:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:42:05.178809 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12275e-8006-4c5a-94cb-3af5d7cf5142 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:05.227816 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:05.288935 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12275e-8006-4c5a-94cb-3af5d7cf5142 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:05.326367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:05.327018 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:05.327295 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:05.327560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:05.328269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] RBAC: Adding query filter params (name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:05.328579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:05.330002 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:05.338842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 424/857] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Aug 22 17:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:05.344918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:05.441932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:05.459882 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290462a-03b0-4d03-9114-05844661c797 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:05.497472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:05.498091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:05.498367 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:05.498634 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:05.509933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:05.511587 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:05.527787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:05.529061 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:05.530366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:05.530366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:05.530366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:05.530366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 434/858] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:05.535548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:05.647765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5696-166f-4cca-80af-109ad2bfdc89 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:05.650402 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:05.685700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:05.686373 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:05.686619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:05.686892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:05.687532 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:05.687826 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:05.689232 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:05.701708 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 425/859] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:05.707871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:05.818498 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd19ba-5386-4ec8-b368-19d9ac9392da None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:05.858668 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:05.859385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:05.859665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:05.859933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:05.862818 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:05.868587 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:05.870476 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:42:05.881716 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:05.882929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:05.884091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 435/860] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:05.888842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:05.989478 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0a4aa-7a39-476e-8ade-90cb8c058775 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:06.025798 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:06.026410 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:06.026679 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:06.026943 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:06.027733 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:06.028209 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:06.029829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:06.049494 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 426/861] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Aug 22 17:42:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:06.055795 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:06.164369 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda280f2-6c55-42a7-9c5d-801ca281df68 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:06.213593 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:06.214231 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:06.214493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:06.214759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:06.286983 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:06.295525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:06.297184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:06.408882 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 436/862] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:42:06 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:42:06.415193 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:06.444867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:06.527936 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aa84f-7550-40e7-a4ee-3e6aeac458a0 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:06.564667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:06.565299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:06.565580 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:06.566224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:06.577348 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:06.578783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:06.593321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:06.594862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:06.596110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:06.596110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:06.596110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:06.596110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 427/863] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:06.600863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:06.704233 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:06.711324 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619ba86-29ad-419e-8470-1ed8bd63fe77 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:06.751164 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:06.751808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:06.752079 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:06.752386 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:06.753144 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:06.753466 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:06.755066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:06.767442 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 437/864] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:06.773523 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:06.863896 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:06.896154 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ee78-01e8-4592-ae18-6e9c75ea6a7f None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:06.935469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:06.936166 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:06.936443 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:06.936821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:06.945049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:06.946507 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:42:06.959283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:06.960677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:06.962233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 428/865] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:06.966659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:07.085115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff201-8820-41d9-9d41-2a77eef183b2 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:07.125301 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2875bf-ee92-4d59-bc1e-835e59589352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:07.125978 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2875bf-ee92-4d59-bc1e-835e59589352 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:07.126294 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2875bf-ee92-4d59-bc1e-835e59589352 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:07.126615 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2875bf-ee92-4d59-bc1e-835e59589352 None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:07.127477 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2875bf-ee92-4d59-bc1e-835e59589352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:07.127839 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2875bf-ee92-4d59-bc1e-835e59589352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:07.129606 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2875bf-ee92-4d59-bc1e-835e59589352 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:07.143446 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 438/866] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:07.150254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:07.264251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e0635-6604-41e2-a5f6-a1b5bd0047e4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:07.302367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c1af-bbd6-490c-907f-c95fc5164e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:07.303135 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c1af-bbd6-490c-907f-c95fc5164e5e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:07.303419 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c1af-bbd6-490c-907f-c95fc5164e5e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:07.303692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c1af-bbd6-490c-907f-c95fc5164e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:07.304447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c1af-bbd6-490c-907f-c95fc5164e5e None admin] RBAC: Adding query filter params (role.id=694a30076f6245a7bc4ed75fa9ef9818, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=cd40f73d7b494ef1ba7e17bdb202ccee) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:07.304794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c1af-bbd6-490c-907f-c95fc5164e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:07.306238 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c1af-bbd6-490c-907f-c95fc5164e5e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:07.308031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:07.314349 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 429/867] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:42:07 2022] GET /identity/v3/role_assignments?user.id=cd40f73d7b494ef1ba7e17bdb202ccee&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=694a30076f6245a7bc4ed75fa9ef9818 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:09.596252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaff228-911e-44eb-aed4-c1a8ccd3331d None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:09.596886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaff228-911e-44eb-aed4-c1a8ccd3331d None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:09.596886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaff228-911e-44eb-aed4-c1a8ccd3331d None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:09.598203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 439/868] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:09.604040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95881090-2987-453b-95f2-8db66d8148ac None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:09.604465 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95881090-2987-453b-95f2-8db66d8148ac None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:09.604784 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95881090-2987-453b-95f2-8db66d8148ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:09.625627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-95881090-2987-453b-95f2-8db66d8148ac None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:09.626890 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-95881090-2987-453b-95f2-8db66d8148ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:09.697724 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 430/869] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:09 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:10.060339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaff228-911e-44eb-aed4-c1a8ccd3331d None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:10.081220 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:10.171151 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaff228-911e-44eb-aed4-c1a8ccd3331d None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:10.211321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:10.211950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:10.212231 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:10.212500 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:10.223928 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:42:10.228577 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:10.232936 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:10.234107 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 440/870] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:10.237069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95881090-2987-453b-95f2-8db66d8148ac None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:10.343692 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95881090-2987-453b-95f2-8db66d8148ac None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:10.372296 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:10.379971 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:10.380628 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:10.380981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:10.381250 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:10.381908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:10.382206 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:10.383564 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:10.391981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 431/871] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:42:10.398349 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:10.478195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:10.502088 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07dc3a-56a9-4ddf-b73a-06fa86537c67 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:10.540321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:10.542359 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:10.542632 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:10.542906 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:10.554109 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:10.555624 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:10.571808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:10.573058 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:10.574145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:10.574145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:10.574145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:10.574358 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 441/872] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:10.580435 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:10.687892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4073ba2-d401-46f5-8147-722359b7bbf4 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:10.727733 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:10.728370 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:10.728731 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:10.729098 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:10.729872 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:10.730286 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:10.732099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:10.745548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 432/873] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:10.752458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:10.880688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632400-f900-4bba-a1ac-8dbd966570ee None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:10.908551 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:10.917454 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:10.918103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:10.918569 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:10.918897 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:10.927639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:10.929289 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:42:10.940892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:10.942168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:10.943120 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 442/874] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:10.948257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:11.004136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:11.060048 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6121eb-43ea-4bed-ab13-f0fee6b16fd3 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:11.100784 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:11.101418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:11.101688 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:11.101950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:11.102690 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:11.103005 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:11.104754 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:11.126895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 433/875] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Aug 22 17:42:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:11.139474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:11.252313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317be93f-61c7-4966-856c-aa739d29cf60 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:11.291688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:11.292302 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:11.292575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:11.292955 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:11.350249 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:11.363029 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:11.364477 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:11.479229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 443/876] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:42:11 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:42:11.485938 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:11.595444 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b796e53-ac7f-4f40-84ce-662bf5b08ec9 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:11.606413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:11.633510 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:11.634156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:11.634431 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:11.634697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:11.646000 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:11.647467 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:11.663263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:11.664423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:11.665439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:11.665439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:11.665439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:11.665439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 434/877] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:11.671330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:11.772826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:11.786518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dbdb-6615-4488-8149-889d28723b1b None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:11.825484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:11.826142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:11.826468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:11.826738 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:11.827573 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:11.828031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:11.829526 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:11.842695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 444/878] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:11.849516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:11.958052 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ea26b-af07-450f-b138-52c2c96f0ae3 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:11.991743 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:11.992369 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:11.992664 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:11.992937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] PATH_INFO: `/v3/projects/service` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:11.999765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:12.001236 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:42:12.012104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:12.013072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:12.013979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 435/879] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:12.019416 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:12.120891 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cdb81-8b31-42ec-831b-1a98da09edcf None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:12.154972 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8d5c2-a65a-4e49-a784-b475acd7a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:12.155650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8d5c2-a65a-4e49-a784-b475acd7a89a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:12.155924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8d5c2-a65a-4e49-a784-b475acd7a89a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:12.156190 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8d5c2-a65a-4e49-a784-b475acd7a89a None admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:12.156909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8d5c2-a65a-4e49-a784-b475acd7a89a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:12.157209 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8d5c2-a65a-4e49-a784-b475acd7a89a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:12.158632 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8d5c2-a65a-4e49-a784-b475acd7a89a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:12.170367 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 445/880] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:12.176975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:12.207771 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:12.293130 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dee43-764c-4cc7-a058-ea08c1c617db None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:12.331689 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2107c-9d46-4212-bae1-8fa00ec39c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:12.332284 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2107c-9d46-4212-bae1-8fa00ec39c84 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:12.332832 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2107c-9d46-4212-bae1-8fa00ec39c84 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:12.333102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2107c-9d46-4212-bae1-8fa00ec39c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:12.333895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2107c-9d46-4212-bae1-8fa00ec39c84 None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=cd40f73d7b494ef1ba7e17bdb202ccee) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:12.334197 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2107c-9d46-4212-bae1-8fa00ec39c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:12.335697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2107c-9d46-4212-bae1-8fa00ec39c84 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:12.342638 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 436/881] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:42:12 2022] GET /identity/v3/role_assignments?user.id=cd40f73d7b494ef1ba7e17bdb202ccee&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=1122faa21ccf460d936f2efb595661ff => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:14.503183 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ed2e-6847-4414-9cb6-faed3a516c6f None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:14.504064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ed2e-6847-4414-9cb6-faed3a516c6f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:14.504064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ed2e-6847-4414-9cb6-faed3a516c6f None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:14.506255 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 446/882] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:14.512435 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ceb9a-cf9d-4593-90c4-a0fe573210b5 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:14.512942 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ceb9a-cf9d-4593-90c4-a0fe573210b5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:14.513088 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ceb9a-cf9d-4593-90c4-a0fe573210b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:14.534166 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-fa0ceb9a-cf9d-4593-90c4-a0fe573210b5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:14.535356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-fa0ceb9a-cf9d-4593-90c4-a0fe573210b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:14.616350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 437/883] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:14 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:14.946068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649ed2e-6847-4414-9cb6-faed3a516c6f None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:14.963335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:15.071278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649ed2e-6847-4414-9cb6-faed3a516c6f None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:15.117485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:15.118353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:15.118721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:15.119059 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:15.131289 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:42:15.136068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:15.137135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:15.138326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 447/884] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:15.143538 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ceb9a-cf9d-4593-90c4-a0fe573210b5 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:15.159023 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:15.247085 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ceb9a-cf9d-4593-90c4-a0fe573210b5 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:15.285406 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:15.285984 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:15.286256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:15.286520 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:15.287176 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] RBAC: Adding query filter params (name=admin) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:15.287474 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:15.288884 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:15.297800 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 438/885] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:15.303796 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:15.383462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:15.427839 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd257d-1987-48ea-bdd4-7cdec0dd0753 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:15.463389 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:15.464009 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:15.464291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:15.464562 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:15.475370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:15.476854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:15.491119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:15.492207 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:15.493180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:15.493180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:15.493180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:15.493180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 448/886] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:15.500318 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:15.597186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:15.626374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8000755-4dee-4f57-938f-c59613b46753 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:15.662597 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:15.663254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:15.663517 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:15.663796 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:15.664414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:15.664744 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:15.666115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:15.677713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 439/887] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:15.686448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:15.796149 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b28ed-9997-45c1-8e0c-937e02a8d77e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:15.820346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:15.840386 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:15.841202 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:15.841473 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:15.841734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] PATH_INFO: `/v3/users/placement` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:15.849737 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:15.851178 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:42:15.863036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:15.864108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:15.865321 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:15.868782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 449/888] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:15.870044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:15.975587 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4a582-6493-4100-ade3-361a985f9060 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:16.010292 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:16.010884 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:16.011152 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:16.011420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:16.012128 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:16.012422 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:16.014104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:16.016650 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:16.040418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 440/889] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Aug 22 17:42:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:16.047845 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:16.156644 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149e995-44f9-4b71-8089-bfc60b990955 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:16.204999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:16.205628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:16.205898 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:16.206167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:16.217523 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:16.218973 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:16.233330 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:16.234384 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:16.235574 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:16.235574 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:16.235574 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:16.235574 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 450/890] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:16.240309 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:16.344716 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdfdcc-2843-425f-82d9-01ad8c720152 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:16.379857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:16.380449 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:16.380756 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:16.381022 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:16.381662 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:16.381957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:16.383319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:16.394649 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 441/891] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:16.403677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:16.435995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:16.507213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4231927-f8a1-488a-8d82-a350210fe788 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:16.541999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:16.542612 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:16.542887 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:16.543157 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:16.550167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:16.551600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:42:16.563700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:16.564742 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:16.570452 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 451/892] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:16.574007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:16.632230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:16.677928 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4ef29-a53c-4b15-a7ef-98e642f46a06 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:16.712528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af58eb-5c74-4dc5-b8de-0ec5aea3526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:16.713159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af58eb-5c74-4dc5-b8de-0ec5aea3526f None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:16.713433 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af58eb-5c74-4dc5-b8de-0ec5aea3526f None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:16.713700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af58eb-5c74-4dc5-b8de-0ec5aea3526f None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:16.714378 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af58eb-5c74-4dc5-b8de-0ec5aea3526f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:16.714676 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af58eb-5c74-4dc5-b8de-0ec5aea3526f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:16.716144 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af58eb-5c74-4dc5-b8de-0ec5aea3526f None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:16.728015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 442/893] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:42:16.735813 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:16.831902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:16.841175 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824737-a83a-4d41-854d-1b9807b3bb4e None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:16.883351 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274d2a-c1ff-47a8-ad91-929d9a696463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:16.884228 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274d2a-c1ff-47a8-ad91-929d9a696463 None admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:16.884695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274d2a-c1ff-47a8-ad91-929d9a696463 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:16.885150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274d2a-c1ff-47a8-ad91-929d9a696463 None admin] PATH_INFO: `/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/cd40f73d7b494ef1ba7e17bdb202ccee/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:16.888405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274d2a-c1ff-47a8-ad91-929d9a696463 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb47a6c68ef54e3d97e6df4288eaf596, user_id=cd40f73d7b494ef1ba7e17bdb202ccee, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:16.889903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274d2a-c1ff-47a8-ad91-929d9a696463 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:16.908776 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 452/894] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Aug 22 17:42:16 2022] PUT /identity/v3/projects/cb47a6c68ef54e3d97e6df4288eaf596/users/cd40f73d7b494ef1ba7e17bdb202ccee/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:42:19.071834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ead83-60b3-4906-a61d-46ae68dbca86 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:19.072687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ead83-60b3-4906-a61d-46ae68dbca86 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:19.072687 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ead83-60b3-4906-a61d-46ae68dbca86 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:19.074791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 443/895] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:19.082010 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154c8f-1432-4a09-a634-6673c89ec9e7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:19.082524 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154c8f-1432-4a09-a634-6673c89ec9e7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:19.082624 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154c8f-1432-4a09-a634-6673c89ec9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:19.110710 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-31154c8f-1432-4a09-a634-6673c89ec9e7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:19.112600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-31154c8f-1432-4a09-a634-6673c89ec9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:19.189491 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 453/896] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:19 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:19.516559 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ead83-60b3-4906-a61d-46ae68dbca86 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:19.643386 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ead83-60b3-4906-a61d-46ae68dbca86 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:19.659743 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:19.681643 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:19.682254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:19.682529 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:19.682793 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:19.693707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:42:19.698317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:19.699374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:19.700840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 444/897] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Aug 22 17:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:19.706365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31154c8f-1432-4a09-a634-6673c89ec9e7 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:19.800766 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:19.826735 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31154c8f-1432-4a09-a634-6673c89ec9e7 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:19.865909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:19.866492 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:19.866768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:19.867062 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:19.867723 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] RBAC: Adding query filter params (name=admin) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:19.868040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:19.869479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:19.878896 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 454/898] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Aug 22 17:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:19.885384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:19.993077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962f63-e9db-496b-8da7-c03edfa1e3ef None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:20.029514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:20.030137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:20.030398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:20.030677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:20.041499 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:20.042939 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:20.057509 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:20.058537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:20.059627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:20.059627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:20.059627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:20.059627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 445/899] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:20.067621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:20.182108 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27463df-fa32-407c-b4b6-6cd98f59636d None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:20.217043 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:20.217631 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:20.217903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:20.218150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:20.218773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:20.219067 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:20.220430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:20.232461 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 455/900] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:20.238576 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:20.280422 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:20.362569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534433-52e2-4a59-8db4-8a9ef48e280a None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:20.397917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:20.398533 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:20.398804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:20.399069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] PATH_INFO: `/v3/users/placement` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:20.407251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:20.408707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:42:20.420167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:20.421417 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:20.422358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 446/901] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:20.427972 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:20.434060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:20.555868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfb67-d77f-4844-914b-72adc4812793 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:20.594485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:20.595084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:20.595363 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:20.595604 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:20.596352 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:20.596661 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:20.598112 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:20.617222 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 456/902] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Aug 22 17:42:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:20.624260 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:20.722127 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:20.739280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9d3b0-3278-409e-bc9f-70913c9b503e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:20.772150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:20.772780 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:20.773049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:20.773318 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:20.846439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:20.847890 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:20.941135 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:20.966655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 447/903] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Aug 22 17:42:20 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:42:20.973276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:21.043026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:21.085480 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d5bd3-2bf7-429f-ab25-1ed6332e4bc2 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:21.124771 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:21.125381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:21.125655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:21.125920 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:21.136406 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:21.137957 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:42:21.153017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:21.154038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:42:21.154995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:42:21.154995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:42:21.154995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:21.154995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 457/904] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:21.161019 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:21.277242 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bb1eb-029f-4230-8234-9a1e0e66144e None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:21.312765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:21.313371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:21.313647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:21.313913 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:21.314547 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:21.314843 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:21.316516 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:21.327741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 448/905] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Aug 22 17:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:21.334285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:21.436572 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012206d-ff12-4c67-8ac0-f1dd5f20cd37 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:21.450840 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:21.478001 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:21.478621 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:21.478899 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:21.479167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] PATH_INFO: `/v3/projects/service` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:21.486034 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:21.487484 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:42:21.498575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:21.499741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:42:21.500918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: ERROR keystone.server.flask.application Aug 22 17:42:21.504792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 458/906] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Aug 22 17:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:21.506301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:21.553395 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:21.609599 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90ec0-cf3e-4deb-9b7a-34b5fa213973 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:21.642910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f113-aa9b-4df4-8de5-38360d428379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:21.643504 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f113-aa9b-4df4-8de5-38360d428379 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:21.643782 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f113-aa9b-4df4-8de5-38360d428379 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:21.644052 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f113-aa9b-4df4-8de5-38360d428379 None admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:21.644778 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5f113-aa9b-4df4-8de5-38360d428379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:21.645072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5f113-aa9b-4df4-8de5-38360d428379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:21.646492 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5f113-aa9b-4df4-8de5-38360d428379 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:21.658573 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 449/907] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Aug 22 17:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:21.665468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:21.781559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5c85-fde3-402b-9300-dfa6abda641a None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:21.817942 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bf3f7-a43f-407f-9588-3a603d7cdbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:21.818478 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf3f7-a43f-407f-9588-3a603d7cdbc7 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:21.818751 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf3f7-a43f-407f-9588-3a603d7cdbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:21.819017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf3f7-a43f-407f-9588-3a603d7cdbc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:21.819727 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bf3f7-a43f-407f-9588-3a603d7cdbc7 None admin] RBAC: Adding query filter params (role.id=1122faa21ccf460d936f2efb595661ff, scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596, user.id=cd40f73d7b494ef1ba7e17bdb202ccee) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:21.820031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bf3f7-a43f-407f-9588-3a603d7cdbc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:21.821483 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bf3f7-a43f-407f-9588-3a603d7cdbc7 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:21.827426 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 459/908] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Aug 22 17:42:21 2022] GET /identity/v3/role_assignments?user.id=cd40f73d7b494ef1ba7e17bdb202ccee&scope.project.id=cb47a6c68ef54e3d97e6df4288eaf596&role.id=1122faa21ccf460d936f2efb595661ff => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:24.023273 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50115c-0fa0-4414-8fe8-97517b3f8938 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:24.024158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50115c-0fa0-4414-8fe8-97517b3f8938 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:24.024158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50115c-0fa0-4414-8fe8-97517b3f8938 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:24.026343 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 450/909] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:24.032467 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1bd6-41cc-481d-86d4-925b1faf850f None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:24.032899 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1bd6-41cc-481d-86d4-925b1faf850f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:24.033060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1bd6-41cc-481d-86d4-925b1faf850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:24.061503 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c55f1bd6-41cc-481d-86d4-925b1faf850f None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:24.062685 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c55f1bd6-41cc-481d-86d4-925b1faf850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:24.094294 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:24.136930 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 460/910] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:24.457707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50115c-0fa0-4414-8fe8-97517b3f8938 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:24.585205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50115c-0fa0-4414-8fe8-97517b3f8938 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:24.592637 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:24.622979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:24.623602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:24.623874 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:24.624136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:24.624754 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:24.626120 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:24.634718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:24.635857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:24.637001 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:24.640753 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 451/911] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Aug 22 17:42:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:24.641846 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f1bd6-41cc-481d-86d4-925b1faf850f None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:24.748168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f1bd6-41cc-481d-86d4-925b1faf850f None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:24.787541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665823-7292-4d52-8ed4-5a4ef2ab8173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:24.788132 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665823-7292-4d52-8ed4-5a4ef2ab8173 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:24.788404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665823-7292-4d52-8ed4-5a4ef2ab8173 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:24.788705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665823-7292-4d52-8ed4-5a4ef2ab8173 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:24.789319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665823-7292-4d52-8ed4-5a4ef2ab8173 None admin] RBAC: Adding query filter params (name=placement) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:24.789616 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665823-7292-4d52-8ed4-5a4ef2ab8173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:24.790975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665823-7292-4d52-8ed4-5a4ef2ab8173 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:24.795829 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 461/912] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Aug 22 17:42:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:24.802095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:24.924195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738d161-456f-400c-a204-7353151e20f0 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:24.960352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a7d4-ead4-4759-8239-03cf22bd78ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:24.960988 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a7d4-ead4-4759-8239-03cf22bd78ad None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:24.961249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a7d4-ead4-4759-8239-03cf22bd78ad None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:24.961523 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a7d4-ead4-4759-8239-03cf22bd78ad None admin] PATH_INFO: `/v3/services` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:24.962147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338a7d4-ead4-4759-8239-03cf22bd78ad None admin] RBAC: Adding query filter params (type=placement) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:24.962456 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338a7d4-ead4-4759-8239-03cf22bd78ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:24.963833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338a7d4-ead4-4759-8239-03cf22bd78ad None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:24.969077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 452/913] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Aug 22 17:42:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:27.106514 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c840306-3c4f-40f2-952b-fc1379bbe943 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:27.107417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c840306-3c4f-40f2-952b-fc1379bbe943 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:27.108002 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c840306-3c4f-40f2-952b-fc1379bbe943 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:27.110275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 462/914] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:27.116712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e132a61-cfa5-4972-bea0-aecf4084d6eb None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:27.117899 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e132a61-cfa5-4972-bea0-aecf4084d6eb None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:27.118317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e132a61-cfa5-4972-bea0-aecf4084d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:27.138938 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-5e132a61-cfa5-4972-bea0-aecf4084d6eb None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:27.140120 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-5e132a61-cfa5-4972-bea0-aecf4084d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:27.169104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:27.213042 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 453/915] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:27.538047 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c840306-3c4f-40f2-952b-fc1379bbe943 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:27.578473 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:27.658893 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c840306-3c4f-40f2-952b-fc1379bbe943 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:27.692334 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7516-7384-42cd-8628-d37b375d61da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:27.692954 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7516-7384-42cd-8628-d37b375d61da None admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:27.693226 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7516-7384-42cd-8628-d37b375d61da None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:27.693490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7516-7384-42cd-8628-d37b375d61da None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:27.694115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7516-7384-42cd-8628-d37b375d61da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:27.695473 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7516-7384-42cd-8628-d37b375d61da None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:27.713845 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 463/916] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Aug 22 17:42:27 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:42:29.914194 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda65e8-ae67-49fd-9cc4-266927473ed2 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:29.914783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda65e8-ae67-49fd-9cc4-266927473ed2 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:29.914783 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda65e8-ae67-49fd-9cc4-266927473ed2 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:29.916328 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 454/917] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:29.922340 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a1b8-a6c5-4eff-9435-9e5fedb374d8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:29.922768 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a1b8-a6c5-4eff-9435-9e5fedb374d8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:29.922878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a1b8-a6c5-4eff-9435-9e5fedb374d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:29.943360 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-ed04a1b8-a6c5-4eff-9435-9e5fedb374d8 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:29.944550 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-ed04a1b8-a6c5-4eff-9435-9e5fedb374d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:30.040497 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 464/918] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:29 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:30.366020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda65e8-ae67-49fd-9cc4-266927473ed2 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:30.488352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda65e8-ae67-49fd-9cc4-266927473ed2 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:30.528087 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:30.528990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:30.529270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:30.529538 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] PATH_INFO: `/v3/services/placement` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:30.530119 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:30.531500 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:30.540320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:30.541489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:30.542338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 455/919] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Aug 22 17:42:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:30.547939 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a1b8-a6c5-4eff-9435-9e5fedb374d8 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:30.570126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:30.657632 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a1b8-a6c5-4eff-9435-9e5fedb374d8 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:30.696411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:30.697034 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:30.697303 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:30.697570 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:30.698186 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] RBAC: Adding query filter params (name=placement) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:30.698488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:30.699842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:30.705962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 465/920] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Aug 22 17:42:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:30.715076 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:30.747157 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:30.840403 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ba32a-04de-499f-81b1-5b228e31c145 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:30.875767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327013c-80d3-4b16-a2a6-f2e0be51956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:30.876358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327013c-80d3-4b16-a2a6-f2e0be51956b None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:30.876655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327013c-80d3-4b16-a2a6-f2e0be51956b None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:30.876919 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327013c-80d3-4b16-a2a6-f2e0be51956b None admin] PATH_INFO: `/v3/endpoints` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:30.877612 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327013c-80d3-4b16-a2a6-f2e0be51956b None admin] RBAC: Adding query filter params (interface=public, service_id=9e186f9d3bb848229285dcc9765e9f82, region_id=RegionOne) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:30.877909 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327013c-80d3-4b16-a2a6-f2e0be51956b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:30.879272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327013c-80d3-4b16-a2a6-f2e0be51956b None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:30.884406 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 456/921] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Aug 22 17:42:30 2022] GET /identity/v3/endpoints?service_id=9e186f9d3bb848229285dcc9765e9f82&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:42:30.891656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:30.978802 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:30.998397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc437e74-5b82-467e-b2a1-dee609014d18 None admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:31.040101 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06a2ac-ecee-4ac4-b2e3-ae0d4b9c833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:31.041028 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06a2ac-ecee-4ac4-b2e3-ae0d4b9c833c None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:31.041419 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06a2ac-ecee-4ac4-b2e3-ae0d4b9c833c None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:31.041833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06a2ac-ecee-4ac4-b2e3-ae0d4b9c833c None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:31.042775 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06a2ac-ecee-4ac4-b2e3-ae0d4b9c833c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:31.044827 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06a2ac-ecee-4ac4-b2e3-ae0d4b9c833c None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:31.051761 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 466/922] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Aug 22 17:42:30 2022] GET /identity/v3/services => generated 1962 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:42:33.185660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26bdd-e95e-429b-9104-820a289f8294 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:33.186557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26bdd-e95e-429b-9104-820a289f8294 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:33.186557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26bdd-e95e-429b-9104-820a289f8294 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:33.188766 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 457/923] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:42:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:42:33.195469 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47ad2-0729-4c0c-9746-2cd7c459fb5f None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:33.195900 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47ad2-0729-4c0c-9746-2cd7c459fb5f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:33.196006 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47ad2-0729-4c0c-9746-2cd7c459fb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:33.218665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-52a47ad2-0729-4c0c-9746-2cd7c459fb5f None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:42:33.219867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-52a47ad2-0729-4c0c-9746-2cd7c459fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:42:33.303765 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 467/924] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:42:33 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:42:33.624295 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d26bdd-e95e-429b-9104-820a289f8294 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:33.753921 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:33.764922 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d26bdd-e95e-429b-9104-820a289f8294 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:33.800675 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:33.801301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:33.801577 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:33.801848 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] PATH_INFO: `/v3/services/placement` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:33.802418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:33.803786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:42:33.812574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:42:33.813678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application with Lock( Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: ERROR keystone.server.flask.application Aug 22 17:42:33.814503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 458/925] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Aug 22 17:42:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:42:33.822044 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47ad2-0729-4c0c-9746-2cd7c459fb5f None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:33.902439 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:33.928314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47ad2-0729-4c0c-9746-2cd7c459fb5f None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:33.964825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc461a29-7f91-4619-9da7-c95ba90524ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:33.965418 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461a29-7f91-4619-9da7-c95ba90524ba None admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:33.965692 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461a29-7f91-4619-9da7-c95ba90524ba None admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:33.965955 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461a29-7f91-4619-9da7-c95ba90524ba None admin] PATH_INFO: `/v3/services` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:33.966771 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc461a29-7f91-4619-9da7-c95ba90524ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:42:33.967074 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc461a29-7f91-4619-9da7-c95ba90524ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:33.968440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc461a29-7f91-4619-9da7-c95ba90524ba None admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:33.973664 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 468/926] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Aug 22 17:42:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:42:33.980510 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:42:34.099247 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34628-7abc-4c21-b403-3709f21eaa63 None admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:42:34.138110 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80906ff4-d4e6-43bf-a207-70edc778863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:42:34.138703 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906ff4-d4e6-43bf-a207-70edc778863d None admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:42:34.138982 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906ff4-d4e6-43bf-a207-70edc778863d None admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:42:34.139251 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906ff4-d4e6-43bf-a207-70edc778863d None admin] PATH_INFO: `/v3/endpoints` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:42:34.139892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80906ff4-d4e6-43bf-a207-70edc778863d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:42:34.141294 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80906ff4-d4e6-43bf-a207-70edc778863d None admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:42:34.166955 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 459/927] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:42:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:42:43.970572 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=30 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:44.160373 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:35.323916 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de58e33-d33a-494b-8a54-77be2b15c55f None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:35.324475 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de58e33-d33a-494b-8a54-77be2b15c55f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:35.324475 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de58e33-d33a-494b-8a54-77be2b15c55f None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:35.328431 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 469/928] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:35.331426 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b1dc-7510-4ec3-92ee-c4af2591056a None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:35.331871 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b1dc-7510-4ec3-92ee-c4af2591056a None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:35.331970 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b1dc-7510-4ec3-92ee-c4af2591056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:35.360799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-4651b1dc-7510-4ec3-92ee-c4af2591056a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:35.362155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-4651b1dc-7510-4ec3-92ee-c4af2591056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:35.460756 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 460/929] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:35.807568 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4d8a-2799-4c75-b493-8d56f7193bb8 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:35.808029 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4d8a-2799-4c75-b493-8d56f7193bb8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:35.808281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4d8a-2799-4c75-b493-8d56f7193bb8 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:35.810568 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 470/930] 10.222.0.59 () {54 vars in 965 bytes} [Mon Aug 22 17:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:35.819573 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df32b0-25a5-476c-8b4d-bd1d000be736 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:35.820333 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df32b0-25a5-476c-8b4d-bd1d000be736 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:35.820954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df32b0-25a5-476c-8b4d-bd1d000be736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:35.895121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-78df32b0-25a5-476c-8b4d-bd1d000be736 None None] MFA Rules not processed for user `17d25b471b4a4c78bea1456094b584c4`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:35.896381 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-78df32b0-25a5-476c-8b4d-bd1d000be736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:35.955857 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 461/931] 10.222.0.59 () {58 vars in 1062 bytes} [Mon Aug 22 17:43:35 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:35.965091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4d8a-2799-4c75-b493-8d56f7193bb8 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:35.977068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4d8a-2799-4c75-b493-8d56f7193bb8 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:35.980699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9256-bef4-4e69-b7ac-c54cdc9a588f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:35.981379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9256-bef4-4e69-b7ac-c54cdc9a588f service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:35.981666 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9256-bef4-4e69-b7ac-c54cdc9a588f service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:35.981913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9256-bef4-4e69-b7ac-c54cdc9a588f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:35.991455 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9256-bef4-4e69-b7ac-c54cdc9a588f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:35.992899 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9256-bef4-4e69-b7ac-c54cdc9a588f service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:36.002754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 471/932] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:43:38.428520 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1df2cb-b1c1-422f-8015-64c93470fa47 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:38.429089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1df2cb-b1c1-422f-8015-64c93470fa47 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:38.429089 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1df2cb-b1c1-422f-8015-64c93470fa47 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:38.430459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 462/933] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:38.435854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433d30-32c0-48db-8177-2e5edb9666a7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:38.436286 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433d30-32c0-48db-8177-2e5edb9666a7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:38.436362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433d30-32c0-48db-8177-2e5edb9666a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:38.456115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-df433d30-32c0-48db-8177-2e5edb9666a7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:38.457317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-df433d30-32c0-48db-8177-2e5edb9666a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:38.465405 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 472/934] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:38.801466 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1df2cb-b1c1-422f-8015-64c93470fa47 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:38.814956 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1df2cb-b1c1-422f-8015-64c93470fa47 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:38.819335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b53aee-2f82-42e4-a50a-b64484c05e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:38.819964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b53aee-2f82-42e4-a50a-b64484c05e72 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:38.820239 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b53aee-2f82-42e4-a50a-b64484c05e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:38.820508 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b53aee-2f82-42e4-a50a-b64484c05e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:38.830829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b53aee-2f82-42e4-a50a-b64484c05e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:38.832306 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b53aee-2f82-42e4-a50a-b64484c05e72 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:38.843084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 463/935] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:43:41.389288 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501d7ba-c18f-499b-87ad-49efa1bf78af None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:41.389863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501d7ba-c18f-499b-87ad-49efa1bf78af None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:41.389863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501d7ba-c18f-499b-87ad-49efa1bf78af None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:41.391142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 473/936] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:41.396647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89fcb-7b1f-4816-a228-571c48098de1 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:41.397081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89fcb-7b1f-4816-a228-571c48098de1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:41.397180 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89fcb-7b1f-4816-a228-571c48098de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:41.437272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-2de89fcb-7b1f-4816-a228-571c48098de1 None None] MFA Rules not processed for user `5bba93f9467f41078298f40969593ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:41.438505 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-2de89fcb-7b1f-4816-a228-571c48098de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:41.481900 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:41.512527 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 464/937] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:41 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:41.855174 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501d7ba-c18f-499b-87ad-49efa1bf78af None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:41.867516 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501d7ba-c18f-499b-87ad-49efa1bf78af None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:41.871127 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77176f76-b7fe-4693-b6c5-b9b1c0c8debe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:41.871733 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77176f76-b7fe-4693-b6c5-b9b1c0c8debe service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:41.872009 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77176f76-b7fe-4693-b6c5-b9b1c0c8debe service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:41.872278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77176f76-b7fe-4693-b6c5-b9b1c0c8debe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:41.882869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77176f76-b7fe-4693-b6c5-b9b1c0c8debe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:41.884327 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77176f76-b7fe-4693-b6c5-b9b1c0c8debe service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:41.894608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 474/938] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:41 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:43:44.708914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2837b-3ee4-4ea6-bc38-6e586ac6bbaa None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:44.709731 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2837b-3ee4-4ea6-bc38-6e586ac6bbaa None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:44.709995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2837b-3ee4-4ea6-bc38-6e586ac6bbaa None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:44.712280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 465/939] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:44.720297 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae72b-afa9-4467-8ee1-3f114a83c3c7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:44.720829 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae72b-afa9-4467-8ee1-3f114a83c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:44.721842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae72b-afa9-4467-8ee1-3f114a83c3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:44.748779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-080ae72b-afa9-4467-8ee1-3f114a83c3c7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:44.749980 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-080ae72b-afa9-4467-8ee1-3f114a83c3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:44.833451 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 475/940] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:44 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:45.176910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2837b-3ee4-4ea6-bc38-6e586ac6bbaa None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:45.193856 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2837b-3ee4-4ea6-bc38-6e586ac6bbaa None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:45.198409 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5aa80-ebcf-4938-b6ab-fdf218360fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:45.199018 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5aa80-ebcf-4938-b6ab-fdf218360fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:45.199296 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5aa80-ebcf-4938-b6ab-fdf218360fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:45.199565 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5aa80-ebcf-4938-b6ab-fdf218360fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:45.210565 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5aa80-ebcf-4938-b6ab-fdf218360fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:45.212016 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5aa80-ebcf-4938-b6ab-fdf218360fa6 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:45.225632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 466/941] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:45 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:43:48.109731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e4c7b-7319-42d4-9375-88b987b827af None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:48.110402 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e4c7b-7319-42d4-9375-88b987b827af None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:48.110402 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e4c7b-7319-42d4-9375-88b987b827af None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:48.111653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 476/942] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:48.117148 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f26b3-3058-4c0d-acd6-830df1c8db00 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:48.117585 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f26b3-3058-4c0d-acd6-830df1c8db00 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:48.117689 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f26b3-3058-4c0d-acd6-830df1c8db00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:48.139082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-b59f26b3-3058-4c0d-acd6-830df1c8db00 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:48.140256 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b59f26b3-3058-4c0d-acd6-830df1c8db00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:48.149161 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 467/943] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:48.487649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e4c7b-7319-42d4-9375-88b987b827af None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:48.500479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e4c7b-7319-42d4-9375-88b987b827af None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:48.504641 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14af20-98cf-46bc-b912-64875a252965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:48.505252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14af20-98cf-46bc-b912-64875a252965 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:48.505528 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14af20-98cf-46bc-b912-64875a252965 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:48.505791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14af20-98cf-46bc-b912-64875a252965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:48.515360 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14af20-98cf-46bc-b912-64875a252965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:48.516820 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14af20-98cf-46bc-b912-64875a252965 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:48.526260 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 477/944] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:43:50.749352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280542-966b-4796-a9f9-abdcd39d51f5 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:50.749937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280542-966b-4796-a9f9-abdcd39d51f5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:50.749937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280542-966b-4796-a9f9-abdcd39d51f5 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:50.751308 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 468/945] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:50.756744 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f944-0122-4c2d-822a-19b66feb7116 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:50.757160 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f944-0122-4c2d-822a-19b66feb7116 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:50.757245 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f944-0122-4c2d-822a-19b66feb7116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:50.777117 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-5426f944-0122-4c2d-822a-19b66feb7116 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:50.778293 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-5426f944-0122-4c2d-822a-19b66feb7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:50.788849 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 478/946] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:51.122569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc280542-966b-4796-a9f9-abdcd39d51f5 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:51.135053 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc280542-966b-4796-a9f9-abdcd39d51f5 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:51.139420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5cfaa-c0f6-40bb-8593-a689f065b745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:51.140016 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5cfaa-c0f6-40bb-8593-a689f065b745 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:51.140290 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5cfaa-c0f6-40bb-8593-a689f065b745 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:51.140553 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5cfaa-c0f6-40bb-8593-a689f065b745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:51.150047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5cfaa-c0f6-40bb-8593-a689f065b745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:51.151496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5cfaa-c0f6-40bb-8593-a689f065b745 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:51.161138 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 469/947] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:43:53.397529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130024c5-2587-4a85-88b1-8a2b2c1082fc None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:53.397984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130024c5-2587-4a85-88b1-8a2b2c1082fc None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:53.398190 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130024c5-2587-4a85-88b1-8a2b2c1082fc None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:53.399557 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 479/948] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:53.405392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05590-c8d3-4e15-841c-30c652f91d30 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:53.405799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05590-c8d3-4e15-841c-30c652f91d30 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:53.405964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05590-c8d3-4e15-841c-30c652f91d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:53.425866 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-a1b05590-c8d3-4e15-841c-30c652f91d30 None None] MFA Rules not processed for user `5bba93f9467f41078298f40969593ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:53.427069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-a1b05590-c8d3-4e15-841c-30c652f91d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:53.435798 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 470/949] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:53 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:53.777791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130024c5-2587-4a85-88b1-8a2b2c1082fc None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:53.789991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130024c5-2587-4a85-88b1-8a2b2c1082fc None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:53.793974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b645-7369-4a0e-80d9-93ff28e2d6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:53.794570 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b645-7369-4a0e-80d9-93ff28e2d6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:53.794975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b645-7369-4a0e-80d9-93ff28e2d6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:53.795251 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b645-7369-4a0e-80d9-93ff28e2d6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:53.804232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2b645-7369-4a0e-80d9-93ff28e2d6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:53.805721 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2b645-7369-4a0e-80d9-93ff28e2d6f3 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:53.815084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 480/950] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:53 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:43:56.229297 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24630-b59b-46b6-ac8a-5526c12eb871 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:56.229869 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24630-b59b-46b6-ac8a-5526c12eb871 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:56.229869 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24630-b59b-46b6-ac8a-5526c12eb871 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:56.231043 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 471/951] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:56.237095 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0487-af34-4229-adfb-1847796b84cc None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:56.237642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0487-af34-4229-adfb-1847796b84cc None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:56.237642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0487-af34-4229-adfb-1847796b84cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:56.259276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-3cef0487-af34-4229-adfb-1847796b84cc None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:56.260642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-3cef0487-af34-4229-adfb-1847796b84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:56.270926 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 481/952] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:56.632052 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6216-7f9f-430a-b397-fe24018a766e None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:56.632328 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6216-7f9f-430a-b397-fe24018a766e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:56.632598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6216-7f9f-430a-b397-fe24018a766e None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:56.634208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 472/953] 10.222.0.59 () {54 vars in 965 bytes} [Mon Aug 22 17:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:56.640431 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa8781-bb78-4c6c-a5b0-9dfda2c2ec24 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:56.640743 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa8781-bb78-4c6c-a5b0-9dfda2c2ec24 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:56.641053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa8781-bb78-4c6c-a5b0-9dfda2c2ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:56.661154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e5aa8781-bb78-4c6c-a5b0-9dfda2c2ec24 None None] MFA Rules not processed for user `17d25b471b4a4c78bea1456094b584c4`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:56.662350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e5aa8781-bb78-4c6c-a5b0-9dfda2c2ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:56.669268 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 482/954] 10.222.0.59 () {58 vars in 1062 bytes} [Mon Aug 22 17:43:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:56.678484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc6216-7f9f-430a-b397-fe24018a766e None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:56.689884 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc6216-7f9f-430a-b397-fe24018a766e None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:56.694892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0340b-6acb-401e-b5e9-bdd9f943ad2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:56.695484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0340b-6acb-401e-b5e9-bdd9f943ad2e service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:56.695758 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0340b-6acb-401e-b5e9-bdd9f943ad2e service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:56.696021 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0340b-6acb-401e-b5e9-bdd9f943ad2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:56.705510 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0340b-6acb-401e-b5e9-bdd9f943ad2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:56.706930 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0340b-6acb-401e-b5e9-bdd9f943ad2e service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:56.716401 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 473/955] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:43:59.171530 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5787e-5689-4ef4-8eb8-18d0f273a127 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:59.172100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5787e-5689-4ef4-8eb8-18d0f273a127 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:59.172100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5787e-5689-4ef4-8eb8-18d0f273a127 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:59.173456 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 483/956] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:43:59.179031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32bf7-d0a8-4cec-9f71-ef9b427b8b57 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:59.179448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32bf7-d0a8-4cec-9f71-ef9b427b8b57 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:59.179557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32bf7-d0a8-4cec-9f71-ef9b427b8b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:59.199916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-72f32bf7-d0a8-4cec-9f71-ef9b427b8b57 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:43:59.201305 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-72f32bf7-d0a8-4cec-9f71-ef9b427b8b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:43:59.209317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 474/957] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:43:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:43:59.550708 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5787e-5689-4ef4-8eb8-18d0f273a127 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:43:59.567154 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5787e-5689-4ef4-8eb8-18d0f273a127 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:43:59.574085 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7d451-27fa-4350-8bca-5ec9f684fe4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:43:59.574984 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d451-27fa-4350-8bca-5ec9f684fe4d service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:43:59.575352 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d451-27fa-4350-8bca-5ec9f684fe4d service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:43:59.575693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d451-27fa-4350-8bca-5ec9f684fe4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:43:59.590475 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7d451-27fa-4350-8bca-5ec9f684fe4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:43:59.591998 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7d451-27fa-4350-8bca-5ec9f684fe4d service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:43:59.610462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 484/958] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:43:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:02.423968 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff1f98-b82e-4032-865c-19979678b69c None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:02.424917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff1f98-b82e-4032-865c-19979678b69c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:02.424917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff1f98-b82e-4032-865c-19979678b69c None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:02.427062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 475/959] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:02.433280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd10d5-c5ec-4e21-b1f5-c92506f51d32 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:02.433704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd10d5-c5ec-4e21-b1f5-c92506f51d32 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:02.433847 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd10d5-c5ec-4e21-b1f5-c92506f51d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:02.461584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-bdfd10d5-c5ec-4e21-b1f5-c92506f51d32 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:02.462799 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-bdfd10d5-c5ec-4e21-b1f5-c92506f51d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:02.471309 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 485/960] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:02 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:02.813893 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff1f98-b82e-4032-865c-19979678b69c None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:02.832634 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff1f98-b82e-4032-865c-19979678b69c None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:02.838702 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a40a3-d2d6-411f-b698-a0d0f749701c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:02.839624 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a40a3-d2d6-411f-b698-a0d0f749701c service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:02.840066 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a40a3-d2d6-411f-b698-a0d0f749701c service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:02.840496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a40a3-d2d6-411f-b698-a0d0f749701c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:02.850700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a40a3-d2d6-411f-b698-a0d0f749701c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:02.852116 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a40a3-d2d6-411f-b698-a0d0f749701c service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:02.861754 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 476/961] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:02 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:07.204115 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286de75-e985-4508-bf30-388975d1c24a None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:07.204751 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286de75-e985-4508-bf30-388975d1c24a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:07.204751 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286de75-e985-4508-bf30-388975d1c24a None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:07.205961 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 486/962] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:07.211562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcf08-c71b-4535-ab46-fa4165bfeaa5 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:07.211985 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcf08-c71b-4535-ab46-fa4165bfeaa5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:07.212163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcf08-c71b-4535-ab46-fa4165bfeaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:07.232350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-1d6dcf08-c71b-4535-ab46-fa4165bfeaa5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:07.233598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-1d6dcf08-c71b-4535-ab46-fa4165bfeaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:07.241844 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 477/963] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:07.577283 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286de75-e985-4508-bf30-388975d1c24a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:07.583665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=77 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:44:07.590756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286de75-e985-4508-bf30-388975d1c24a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:07.594640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169597b-898b-4b5e-8e1d-754aea6fdb0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:07.595242 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169597b-898b-4b5e-8e1d-754aea6fdb0d service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:07.595514 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169597b-898b-4b5e-8e1d-754aea6fdb0d service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:07.595780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169597b-898b-4b5e-8e1d-754aea6fdb0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:07.605398 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169597b-898b-4b5e-8e1d-754aea6fdb0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:07.606849 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169597b-898b-4b5e-8e1d-754aea6fdb0d service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:07.617184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 487/964] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:10.408436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc079-c639-434a-a0cc-5dc52ac5a25b None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:10.408968 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc079-c639-434a-a0cc-5dc52ac5a25b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:10.408968 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc079-c639-434a-a0cc-5dc52ac5a25b None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:10.410452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 478/965] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:10.415640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72f4cb-5cab-4eed-a29c-45647230dc46 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:10.416081 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72f4cb-5cab-4eed-a29c-45647230dc46 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:10.416163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72f4cb-5cab-4eed-a29c-45647230dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:10.435560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-fb72f4cb-5cab-4eed-a29c-45647230dc46 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:10.436753 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-fb72f4cb-5cab-4eed-a29c-45647230dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:10.445266 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 488/966] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:10 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:10.786142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc079-c639-434a-a0cc-5dc52ac5a25b None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:10.798144 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc079-c639-434a-a0cc-5dc52ac5a25b None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:10.802170 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64897ca0-65c2-4140-a0f9-aa1e0c70522a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:10.802777 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897ca0-65c2-4140-a0f9-aa1e0c70522a service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:10.803049 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897ca0-65c2-4140-a0f9-aa1e0c70522a service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:10.803313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897ca0-65c2-4140-a0f9-aa1e0c70522a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:10.813619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64897ca0-65c2-4140-a0f9-aa1e0c70522a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:10.815158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64897ca0-65c2-4140-a0f9-aa1e0c70522a service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:10.827021 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 479/967] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:10 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:14.932659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30526ef1-46aa-4073-91f6-eba2f4693e95 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:14.933232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30526ef1-46aa-4073-91f6-eba2f4693e95 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:14.933232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30526ef1-46aa-4073-91f6-eba2f4693e95 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:14.934525 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 489/968] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:14.940230 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38b3a-4688-4318-9496-7438c8f0364c None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:14.940808 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38b3a-4688-4318-9496-7438c8f0364c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:14.940808 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38b3a-4688-4318-9496-7438c8f0364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:14.948554 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=54 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:44:14.962805 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-02b38b3a-4688-4318-9496-7438c8f0364c None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:14.964301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-02b38b3a-4688-4318-9496-7438c8f0364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:14.973484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 480/969] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:15.309363 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30526ef1-46aa-4073-91f6-eba2f4693e95 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:15.320631 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30526ef1-46aa-4073-91f6-eba2f4693e95 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:15.324175 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af2aa8-6c33-4cb7-bcf5-fb32039cd856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:15.324869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2aa8-6c33-4cb7-bcf5-fb32039cd856 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:15.325148 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2aa8-6c33-4cb7-bcf5-fb32039cd856 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:15.325417 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2aa8-6c33-4cb7-bcf5-fb32039cd856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:15.334552 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af2aa8-6c33-4cb7-bcf5-fb32039cd856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:15.335974 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af2aa8-6c33-4cb7-bcf5-fb32039cd856 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:15.345689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 490/970] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:20.789140 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efd24-07ad-4088-8d66-cc14e2d454dd None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:20.789633 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efd24-07ad-4088-8d66-cc14e2d454dd None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:20.789712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efd24-07ad-4088-8d66-cc14e2d454dd None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:20.791039 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 481/971] 10.222.0.59 () {54 vars in 921 bytes} [Mon Aug 22 17:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:20.809334 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dbc7e-e4a9-48fb-b0c6-367e784e8aa3 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:20.809754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dbc7e-e4a9-48fb-b0c6-367e784e8aa3 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:20.810203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dbc7e-e4a9-48fb-b0c6-367e784e8aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:20.900521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-a44dbc7e-e4a9-48fb-b0c6-367e784e8aa3 None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:20.902894 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-a44dbc7e-e4a9-48fb-b0c6-367e784e8aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:21.016953 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 491/972] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Aug 22 17:44:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:44:24.959359 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=2 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:44:25.412806 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea03b2-e441-4446-8703-a6a7dc461c04 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:25.415280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea03b2-e441-4446-8703-a6a7dc461c04 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:25.415573 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea03b2-e441-4446-8703-a6a7dc461c04 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:25.417378 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 482/973] 10.222.0.59 () {54 vars in 921 bytes} [Mon Aug 22 17:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:25.423412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83b143-ee0a-4363-8655-1bd051535342 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:25.423924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83b143-ee0a-4363-8655-1bd051535342 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:25.424177 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83b143-ee0a-4363-8655-1bd051535342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:25.444645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-1a83b143-ee0a-4363-8655-1bd051535342 None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:25.446017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-1a83b143-ee0a-4363-8655-1bd051535342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:25.455791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 492/974] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Aug 22 17:44:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:27.101678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618ad92-ea3c-47dd-ad64-02e017f5acd2 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:27.102272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618ad92-ea3c-47dd-ad64-02e017f5acd2 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:27.102272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618ad92-ea3c-47dd-ad64-02e017f5acd2 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:27.103565 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 483/975] 10.222.0.59 () {54 vars in 921 bytes} [Mon Aug 22 17:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:27.109704 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccffb3-d925-4815-9f15-58392c04cc9e None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:27.110270 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccffb3-d925-4815-9f15-58392c04cc9e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:27.110518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccffb3-d925-4815-9f15-58392c04cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:27.133094 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c7ccffb3-d925-4815-9f15-58392c04cc9e None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:27.134701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c7ccffb3-d925-4815-9f15-58392c04cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:27.144807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 493/976] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Aug 22 17:44:27 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:30.872534 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73745dd-c758-4a32-9cf4-75e74c0e719b None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:30.873602 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73745dd-c758-4a32-9cf4-75e74c0e719b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:30.874098 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73745dd-c758-4a32-9cf4-75e74c0e719b None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:30.875912 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 484/977] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:30.881650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898587f1-2daa-40c9-b813-c78a5c517105 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:30.882098 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898587f1-2daa-40c9-b813-c78a5c517105 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:30.882198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898587f1-2daa-40c9-b813-c78a5c517105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:30.904027 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-898587f1-2daa-40c9-b813-c78a5c517105 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:30.905579 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-898587f1-2daa-40c9-b813-c78a5c517105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:30.914137 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 494/978] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:31.275259 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a667f5-e932-4f71-9d8f-5bd32cc64fad None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:31.275776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a667f5-e932-4f71-9d8f-5bd32cc64fad None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:31.276274 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a667f5-e932-4f71-9d8f-5bd32cc64fad None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:31.278080 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 485/979] 10.222.0.59 () {54 vars in 962 bytes} [Mon Aug 22 17:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:31.286134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159376-1bb9-4133-8ef1-44ee48058233 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:31.286277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159376-1bb9-4133-8ef1-44ee48058233 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:31.286576 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159376-1bb9-4133-8ef1-44ee48058233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:31.331398 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-4d159376-1bb9-4133-8ef1-44ee48058233 None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:31.332868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4d159376-1bb9-4133-8ef1-44ee48058233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:31.402643 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:44:31.408852 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 495/980] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Aug 22 17:44:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:31.416249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a667f5-e932-4f71-9d8f-5bd32cc64fad None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:31.430247 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a667f5-e932-4f71-9d8f-5bd32cc64fad None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:31.435446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738fd9b-4ace-4b71-9f84-98a9403b0b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:31.436218 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738fd9b-4ace-4b71-9f84-98a9403b0b2d service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:31.436653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738fd9b-4ace-4b71-9f84-98a9403b0b2d service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:31.437098 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738fd9b-4ace-4b71-9f84-98a9403b0b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:31.446537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738fd9b-4ace-4b71-9f84-98a9403b0b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:31.448109 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738fd9b-4ace-4b71-9f84-98a9403b0b2d service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:31.458252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 486/981] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:33.864052 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaab380-f2d7-4551-ab47-59b2bb39c257 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:33.864555 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaab380-f2d7-4551-ab47-59b2bb39c257 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:33.864654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaab380-f2d7-4551-ab47-59b2bb39c257 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:33.866585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 496/982] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:44:33.871675 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d3988-4a42-4660-90c0-67e52ec72e35 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:33.872934 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d3988-4a42-4660-90c0-67e52ec72e35 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:33.873459 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d3988-4a42-4660-90c0-67e52ec72e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:33.894315 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-624d3988-4a42-4660-90c0-67e52ec72e35 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:33.895526 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-624d3988-4a42-4660-90c0-67e52ec72e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:33.905586 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 487/983] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:44:34.246619 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaab380-f2d7-4551-ab47-59b2bb39c257 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:34.266744 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaab380-f2d7-4551-ab47-59b2bb39c257 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:34.276300 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0db0-7eb8-4736-8949-457c34a21097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:34.276948 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0db0-7eb8-4736-8949-457c34a21097 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:34.277195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0db0-7eb8-4736-8949-457c34a21097 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:34.277495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0db0-7eb8-4736-8949-457c34a21097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:34.287025 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0db0-7eb8-4736-8949-457c34a21097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:34.288769 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0db0-7eb8-4736-8949-457c34a21097 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:34.299290 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 497/984] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:36.839317 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2be2b-20d3-4fd8-a8f8-ec4b0bda9ef0 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:36.839921 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2be2b-20d3-4fd8-a8f8-ec4b0bda9ef0 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:36.839921 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2be2b-20d3-4fd8-a8f8-ec4b0bda9ef0 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:36.841457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 488/985] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:36.846765 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42faf0-4a24-40f4-9b32-704bd322851e None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:36.847225 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42faf0-4a24-40f4-9b32-704bd322851e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:36.847339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42faf0-4a24-40f4-9b32-704bd322851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:36.867399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-3a42faf0-4a24-40f4-9b32-704bd322851e None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:36.868594 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-3a42faf0-4a24-40f4-9b32-704bd322851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:36.876864 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 498/986] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:37.232209 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b718-2ba8-4f1c-b937-7c71c2400027 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:37.232486 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b718-2ba8-4f1c-b937-7c71c2400027 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:37.232805 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b718-2ba8-4f1c-b937-7c71c2400027 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:37.234257 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 489/987] 10.222.0.59 () {54 vars in 962 bytes} [Mon Aug 22 17:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:37.239902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bff10-b480-44b9-8e27-3e3e29c6c20f None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:37.240764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bff10-b480-44b9-8e27-3e3e29c6c20f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:37.241084 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bff10-b480-44b9-8e27-3e3e29c6c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:37.264497 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-6d0bff10-b480-44b9-8e27-3e3e29c6c20f None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:37.266663 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-6d0bff10-b480-44b9-8e27-3e3e29c6c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:37.284970 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 499/988] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Aug 22 17:44:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:37.290654 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42b718-2ba8-4f1c-b937-7c71c2400027 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:37.305150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42b718-2ba8-4f1c-b937-7c71c2400027 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:37.311448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23532-32b6-4eb2-a22c-f718d5cd3247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:37.312152 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23532-32b6-4eb2-a22c-f718d5cd3247 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:37.312426 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23532-32b6-4eb2-a22c-f718d5cd3247 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:37.312748 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23532-32b6-4eb2-a22c-f718d5cd3247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:37.321472 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23532-32b6-4eb2-a22c-f718d5cd3247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:37.323302 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23532-32b6-4eb2-a22c-f718d5cd3247 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:37.333681 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 490/989] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:39.684987 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb08f-ec82-4394-bed2-55a473faaa18 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:39.686423 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb08f-ec82-4394-bed2-55a473faaa18 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:39.687291 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb08f-ec82-4394-bed2-55a473faaa18 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:39.695882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825cfcc-8778-403a-913c-b05aee543759 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:39.696932 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825cfcc-8778-403a-913c-b05aee543759 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:39.697483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825cfcc-8778-403a-913c-b05aee543759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:39.700907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 500/990] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:39 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:39.721164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-0825cfcc-8778-403a-913c-b05aee543759 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:39.722926 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-0825cfcc-8778-403a-913c-b05aee543759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:39.737253 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 491/991] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:44:40.129927 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fb08f-ec82-4394-bed2-55a473faaa18 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:40.144650 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fb08f-ec82-4394-bed2-55a473faaa18 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:40.150053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeec85a-c341-4f72-880c-06d6945c3478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:40.150892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec85a-c341-4f72-880c-06d6945c3478 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:40.151370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec85a-c341-4f72-880c-06d6945c3478 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:40.151855 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec85a-c341-4f72-880c-06d6945c3478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:40.161088 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec85a-c341-4f72-880c-06d6945c3478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:40.162948 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec85a-c341-4f72-880c-06d6945c3478 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:40.185344 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 501/992] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:41.080588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806544b-9ebe-4720-9517-8b01520f58b3 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:41.081095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806544b-9ebe-4720-9517-8b01520f58b3 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:41.081207 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806544b-9ebe-4720-9517-8b01520f58b3 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:41.083660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 492/993] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:41.089339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd2f1-a1dd-450d-a66c-611b3037d113 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:41.089722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd2f1-a1dd-450d-a66c-611b3037d113 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:41.090167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd2f1-a1dd-450d-a66c-611b3037d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:41.121213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-0ddbd2f1-a1dd-450d-a66c-611b3037d113 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:41.123104 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-0ddbd2f1-a1dd-450d-a66c-611b3037d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:41.151066 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 502/994] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:41.779223 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d568b-8970-4e14-8eb0-c1ad389bad1e None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:41.780677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d568b-8970-4e14-8eb0-c1ad389bad1e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:41.780677 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d568b-8970-4e14-8eb0-c1ad389bad1e None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:41.781752 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 493/995] 10.222.0.59 () {54 vars in 964 bytes} [Mon Aug 22 17:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:41.786805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e603a4-fc80-4a21-a327-ac9126843a93 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:41.787205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e603a4-fc80-4a21-a327-ac9126843a93 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:41.787585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e603a4-fc80-4a21-a327-ac9126843a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:41.830683 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c6e603a4-fc80-4a21-a327-ac9126843a93 None None] MFA Rules not processed for user `51c432d2d2ec4be6b34839a86ce15036`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:41.832334 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c6e603a4-fc80-4a21-a327-ac9126843a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:41.900645 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 503/996] 10.222.0.59 () {58 vars in 1061 bytes} [Mon Aug 22 17:44:41 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:41.907064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d568b-8970-4e14-8eb0-c1ad389bad1e None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:41.918752 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d568b-8970-4e14-8eb0-c1ad389bad1e None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:41.922837 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b698-5f32-4d1b-a2bd-e41cf5038a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c432d2d2ec4be6b34839a86ce15036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:41.923567 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b698-5f32-4d1b-a2bd-e41cf5038a47 service cinder] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:41.923950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b698-5f32-4d1b-a2bd-e41cf5038a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:41.924313 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b698-5f32-4d1b-a2bd-e41cf5038a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:41.934390 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2b698-5f32-4d1b-a2bd-e41cf5038a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:41.936351 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2b698-5f32-4d1b-a2bd-e41cf5038a47 service cinder] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:41.948812 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 494/997] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:42.602151 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b46d-4a84-475a-9f83-a0bc1803f108 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:42.602758 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b46d-4a84-475a-9f83-a0bc1803f108 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:42.602758 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b46d-4a84-475a-9f83-a0bc1803f108 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:42.604068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 504/998] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:42.610952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285dea8-8244-4135-a908-7e1cddc5cc75 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:42.611560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285dea8-8244-4135-a908-7e1cddc5cc75 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:42.612145 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285dea8-8244-4135-a908-7e1cddc5cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:42.634319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-f285dea8-8244-4135-a908-7e1cddc5cc75 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:42.635729 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-f285dea8-8244-4135-a908-7e1cddc5cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:42.648700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 495/999] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:43.016205 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690b46d-4a84-475a-9f83-a0bc1803f108 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:43.042006 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690b46d-4a84-475a-9f83-a0bc1803f108 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:43.053213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62197493-89c4-4534-bce2-f9d548cdcb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:43.054106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62197493-89c4-4534-bce2-f9d548cdcb6b service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:43.054563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62197493-89c4-4534-bce2-f9d548cdcb6b service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:43.055100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62197493-89c4-4534-bce2-f9d548cdcb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:43.076880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62197493-89c4-4534-bce2-f9d548cdcb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:43.079426 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62197493-89c4-4534-bce2-f9d548cdcb6b service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:43.106809 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 505/1000] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:45.628167 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1948a-5f89-4e8f-91c4-40751ae03ce5 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:45.628813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1948a-5f89-4e8f-91c4-40751ae03ce5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:45.628813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1948a-5f89-4e8f-91c4-40751ae03ce5 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:45.630334 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 496/1001] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:45.635732 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6da33-4188-4193-9cda-ebc7fa6d25d8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:45.636794 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6da33-4188-4193-9cda-ebc7fa6d25d8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:45.637403 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6da33-4188-4193-9cda-ebc7fa6d25d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:45.675680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e2e6da33-4188-4193-9cda-ebc7fa6d25d8 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:45.677015 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e2e6da33-4188-4193-9cda-ebc7fa6d25d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:45.686791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 506/1002] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:46.055936 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1948a-5f89-4e8f-91c4-40751ae03ce5 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:46.070007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1948a-5f89-4e8f-91c4-40751ae03ce5 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:46.075097 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea3f6-794c-49bb-9fb2-7e3b7be7a201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:46.075733 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea3f6-794c-49bb-9fb2-7e3b7be7a201 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:46.076102 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea3f6-794c-49bb-9fb2-7e3b7be7a201 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:46.076375 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea3f6-794c-49bb-9fb2-7e3b7be7a201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:46.084457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea3f6-794c-49bb-9fb2-7e3b7be7a201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:46.090679 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea3f6-794c-49bb-9fb2-7e3b7be7a201 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:46.104139 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 497/1003] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:48.382353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad04c6-c7ff-40fb-ad53-79bf599e4675 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:48.382913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad04c6-c7ff-40fb-ad53-79bf599e4675 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:48.382913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad04c6-c7ff-40fb-ad53-79bf599e4675 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:48.384160 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 507/1004] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:48.390321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ee6e-392c-42e8-8714-1bca89c11756 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:48.390795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ee6e-392c-42e8-8714-1bca89c11756 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:48.391017 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ee6e-392c-42e8-8714-1bca89c11756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:48.414639 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-b4d2ee6e-392c-42e8-8714-1bca89c11756 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:48.416189 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b4d2ee6e-392c-42e8-8714-1bca89c11756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:48.424925 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 498/1005] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:48.771919 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad04c6-c7ff-40fb-ad53-79bf599e4675 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:48.788583 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad04c6-c7ff-40fb-ad53-79bf599e4675 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:48.794759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24874-1e0a-4d6b-ae3e-fffdaafc49fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:48.795807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24874-1e0a-4d6b-ae3e-fffdaafc49fa service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:48.796119 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24874-1e0a-4d6b-ae3e-fffdaafc49fa service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:48.796456 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24874-1e0a-4d6b-ae3e-fffdaafc49fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:48.808779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24874-1e0a-4d6b-ae3e-fffdaafc49fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:48.816175 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24874-1e0a-4d6b-ae3e-fffdaafc49fa service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:48.830472 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 508/1006] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:51.219369 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbf81-693f-493f-9341-162618494168 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:51.219908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbf81-693f-493f-9341-162618494168 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:51.219908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbf81-693f-493f-9341-162618494168 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:51.221546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 499/1007] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:51.228908 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60b611-3412-4d4c-b274-712c035613f2 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:51.229394 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60b611-3412-4d4c-b274-712c035613f2 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:51.229827 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60b611-3412-4d4c-b274-712c035613f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:51.256826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-9e60b611-3412-4d4c-b274-712c035613f2 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:51.258350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-9e60b611-3412-4d4c-b274-712c035613f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:51.268073 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 509/1008] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:51.633880 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cbf81-693f-493f-9341-162618494168 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:51.651855 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cbf81-693f-493f-9341-162618494168 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:51.657384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98d6b-1d41-49ae-bc7f-2dba7ed00f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:51.657989 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98d6b-1d41-49ae-bc7f-2dba7ed00f5a service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:51.658266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98d6b-1d41-49ae-bc7f-2dba7ed00f5a service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:51.658534 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98d6b-1d41-49ae-bc7f-2dba7ed00f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:51.667369 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98d6b-1d41-49ae-bc7f-2dba7ed00f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:51.669108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98d6b-1d41-49ae-bc7f-2dba7ed00f5a service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:51.679280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 500/1009] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:54.331627 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731e0b-9f6a-4f71-a450-75ff01e46e10 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:54.332468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731e0b-9f6a-4f71-a450-75ff01e46e10 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:54.332468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731e0b-9f6a-4f71-a450-75ff01e46e10 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:54.333543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 510/1010] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:44:54.339064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ea68-3c97-4d37-b33a-c5db619012f9 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:54.339811 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ea68-3c97-4d37-b33a-c5db619012f9 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:54.339811 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ea68-3c97-4d37-b33a-c5db619012f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:54.361103 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-8a47ea68-3c97-4d37-b33a-c5db619012f9 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:54.362311 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-8a47ea68-3c97-4d37-b33a-c5db619012f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:54.370990 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 501/1011] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:54.721858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731e0b-9f6a-4f71-a450-75ff01e46e10 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:54.736834 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731e0b-9f6a-4f71-a450-75ff01e46e10 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:54.742315 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b013e8-3044-482e-bcd1-c16cbc68aa90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:54.742918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b013e8-3044-482e-bcd1-c16cbc68aa90 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:54.743199 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b013e8-3044-482e-bcd1-c16cbc68aa90 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:54.743465 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b013e8-3044-482e-bcd1-c16cbc68aa90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:54.752598 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b013e8-3044-482e-bcd1-c16cbc68aa90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:54.754231 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b013e8-3044-482e-bcd1-c16cbc68aa90 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:54.764713 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 511/1012] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:44:57.317215 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d46f4-333c-4a5a-b143-b20d556c7c94 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:57.317841 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d46f4-333c-4a5a-b143-b20d556c7c94 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:57.317841 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d46f4-333c-4a5a-b143-b20d556c7c94 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:57.319349 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 502/1013] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:44:57.325902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1700be-e9b9-493a-8ca8-77bf2ec064ef None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:57.326439 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1700be-e9b9-493a-8ca8-77bf2ec064ef None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:57.326628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1700be-e9b9-493a-8ca8-77bf2ec064ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:57.352239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-be1700be-e9b9-493a-8ca8-77bf2ec064ef None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:44:57.353546 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-be1700be-e9b9-493a-8ca8-77bf2ec064ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:44:57.369539 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 512/1014] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:44:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:44:57.993466 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d46f4-333c-4a5a-b143-b20d556c7c94 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:44:58.003108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=46 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:44:58.014456 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d46f4-333c-4a5a-b143-b20d556c7c94 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:44:58.019916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad92d6-6c8b-4779-bee0-3152d4c026f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:44:58.020683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad92d6-6c8b-4779-bee0-3152d4c026f1 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:44:58.020965 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad92d6-6c8b-4779-bee0-3152d4c026f1 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:44:58.021299 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad92d6-6c8b-4779-bee0-3152d4c026f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:44:58.030430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad92d6-6c8b-4779-bee0-3152d4c026f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:44:58.032016 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad92d6-6c8b-4779-bee0-3152d4c026f1 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:44:58.041964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 503/1015] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:44:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:00.535530 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256df8-80db-4324-ba97-c7a772a82e05 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:00.536214 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256df8-80db-4324-ba97-c7a772a82e05 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:00.536569 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256df8-80db-4324-ba97-c7a772a82e05 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:00.538446 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 513/1016] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:45:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:00.544269 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148ee1e-d8ac-43df-bac8-2985d20ed27e None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:00.544829 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148ee1e-d8ac-43df-bac8-2985d20ed27e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:00.544938 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148ee1e-d8ac-43df-bac8-2985d20ed27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:00.570949 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-b148ee1e-d8ac-43df-bac8-2985d20ed27e None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:00.572957 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b148ee1e-d8ac-43df-bac8-2985d20ed27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:00.583330 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 504/1017] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:45:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:00.923077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca256df8-80db-4324-ba97-c7a772a82e05 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:00.940717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca256df8-80db-4324-ba97-c7a772a82e05 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:00.947410 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143e507-5800-413e-9f09-ca45c7120b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:00.948157 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e507-5800-413e-9f09-ca45c7120b43 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:00.948490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e507-5800-413e-9f09-ca45c7120b43 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:00.948871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e507-5800-413e-9f09-ca45c7120b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:00.960485 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143e507-5800-413e-9f09-ca45c7120b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:00.962448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143e507-5800-413e-9f09-ca45c7120b43 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:00.975616 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 514/1018] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:03.305597 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc511bc-26ee-41ba-a251-3f40f6ce0b07 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:03.306220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc511bc-26ee-41ba-a251-3f40f6ce0b07 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:03.306220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc511bc-26ee-41ba-a251-3f40f6ce0b07 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:03.307546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 505/1019] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:03.313306 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c915-4c76-4da3-8f13-c5bd2adfdb40 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:03.313759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c915-4c76-4da3-8f13-c5bd2adfdb40 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:03.313859 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c915-4c76-4da3-8f13-c5bd2adfdb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:03.322092 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=89 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:03.335541 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-ff30c915-4c76-4da3-8f13-c5bd2adfdb40 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:03.336762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-ff30c915-4c76-4da3-8f13-c5bd2adfdb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:03.344883 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 515/1020] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:45:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:03.690134 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc511bc-26ee-41ba-a251-3f40f6ce0b07 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:03.705057 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc511bc-26ee-41ba-a251-3f40f6ce0b07 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:03.710223 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d1a3-cd50-4f9d-ae3d-4718c0892ece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:03.710820 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d1a3-cd50-4f9d-ae3d-4718c0892ece service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:03.711093 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d1a3-cd50-4f9d-ae3d-4718c0892ece service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:03.711362 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d1a3-cd50-4f9d-ae3d-4718c0892ece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:03.720090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d1a3-cd50-4f9d-ae3d-4718c0892ece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:03.721720 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d1a3-cd50-4f9d-ae3d-4718c0892ece service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:03.732727 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 506/1021] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:03.907598 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea5fe-0118-497e-8d79-1f49eaff7ffb None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:03.907867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea5fe-0118-497e-8d79-1f49eaff7ffb None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:03.908228 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea5fe-0118-497e-8d79-1f49eaff7ffb None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:03.909673 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 516/1022] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:03.915524 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbba18-c464-4527-a10c-975bd69b5379 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:03.915811 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbba18-c464-4527-a10c-975bd69b5379 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:03.916082 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbba18-c464-4527-a10c-975bd69b5379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:03.936465 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-44fbba18-c464-4527-a10c-975bd69b5379 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:03.937751 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-44fbba18-c464-4527-a10c-975bd69b5379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:03.946515 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 507/1023] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:45:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:04.305824 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d31d-0994-44e0-bb8b-9cc8e2e9f890 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:04.306111 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d31d-0994-44e0-bb8b-9cc8e2e9f890 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:04.306367 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d31d-0994-44e0-bb8b-9cc8e2e9f890 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:04.307752 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 517/1024] 10.222.0.59 () {54 vars in 967 bytes} [Mon Aug 22 17:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:04.313532 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4ec1-b2eb-4a12-ae2f-c1aa638536db None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:04.314038 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4ec1-b2eb-4a12-ae2f-c1aa638536db None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:04.314038 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4ec1-b2eb-4a12-ae2f-c1aa638536db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:04.352407 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-f56e4ec1-b2eb-4a12-ae2f-c1aa638536db None None] MFA Rules not processed for user `a0b91ae7fe5246bb9bb838bc5a4cc099`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:04.353653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-f56e4ec1-b2eb-4a12-ae2f-c1aa638536db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:04.429275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 508/1025] 10.222.0.59 () {58 vars in 1064 bytes} [Mon Aug 22 17:45:04 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:04.437491 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d31d-0994-44e0-bb8b-9cc8e2e9f890 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:04.449952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d31d-0994-44e0-bb8b-9cc8e2e9f890 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:04.454649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d5e23-9e52-4909-8b91-4d19b06edecd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b91ae7fe5246bb9bb838bc5a4cc099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:04.455239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d5e23-9e52-4909-8b91-4d19b06edecd service glance] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:04.455514 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d5e23-9e52-4909-8b91-4d19b06edecd service glance] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:04.455784 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d5e23-9e52-4909-8b91-4d19b06edecd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:04.465696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d5e23-9e52-4909-8b91-4d19b06edecd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:04.467017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d5e23-9e52-4909-8b91-4d19b06edecd service glance] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:04.477180 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 518/1026] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:14.426126 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=50 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:14.472520 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=8 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:19.993836 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6e5b-76e3-4544-8809-2eeb99292f05 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:19.994414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6e5b-76e3-4544-8809-2eeb99292f05 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:19.994414 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6e5b-76e3-4544-8809-2eeb99292f05 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:19.995623 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 509/1027] 10.222.0.59 () {54 vars in 918 bytes} [Mon Aug 22 17:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:20.001232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a974cce-8c92-4862-a4cb-0e9d658da2c0 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:20.001769 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a974cce-8c92-4862-a4cb-0e9d658da2c0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:20.001769 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a974cce-8c92-4862-a4cb-0e9d658da2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:20.021995 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-9a974cce-8c92-4862-a4cb-0e9d658da2c0 None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:20.024655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-9a974cce-8c92-4862-a4cb-0e9d658da2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:20.033633 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 519/1028] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Aug 22 17:45:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:20.048656 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1b7c-50e5-4dd6-9544-7dd5c64aea58 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:20.049010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1b7c-50e5-4dd6-9544-7dd5c64aea58 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:20.049413 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1b7c-50e5-4dd6-9544-7dd5c64aea58 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:20.051442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 510/1029] 10.222.0.59 () {54 vars in 918 bytes} [Mon Aug 22 17:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:20.059745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dac16d-0b84-449e-88fe-0a2e0b29fe62 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:20.060030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dac16d-0b84-449e-88fe-0a2e0b29fe62 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:20.060303 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dac16d-0b84-449e-88fe-0a2e0b29fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:20.082440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-99dac16d-0b84-449e-88fe-0a2e0b29fe62 None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:20.083640 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-99dac16d-0b84-449e-88fe-0a2e0b29fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:20.094163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 520/1030] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Aug 22 17:45:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:22.810408 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f023-5859-406f-8a4c-1d189e9db7a1 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:22.811040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f023-5859-406f-8a4c-1d189e9db7a1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:22.811040 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f023-5859-406f-8a4c-1d189e9db7a1 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:22.812285 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 511/1031] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:22.818262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da427110-9475-4ec6-8eff-f9a031109c4a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:22.818715 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da427110-9475-4ec6-8eff-f9a031109c4a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:22.818805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da427110-9475-4ec6-8eff-f9a031109c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:22.838741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-da427110-9475-4ec6-8eff-f9a031109c4a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:22.839933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-da427110-9475-4ec6-8eff-f9a031109c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:22.850257 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 521/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:45:23.207814 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f023-5859-406f-8a4c-1d189e9db7a1 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:23.225788 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f023-5859-406f-8a4c-1d189e9db7a1 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:23.231132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591969c0-046c-494e-b262-35bbfdf0388d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:23.231732 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591969c0-046c-494e-b262-35bbfdf0388d service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:23.232015 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591969c0-046c-494e-b262-35bbfdf0388d service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:23.232289 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591969c0-046c-494e-b262-35bbfdf0388d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:23.240672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591969c0-046c-494e-b262-35bbfdf0388d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:23.242559 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591969c0-046c-494e-b262-35bbfdf0388d service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:23.252095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 512/1033] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:24.231492 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a897f33-31fc-4eec-8b98-8302395176ee None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:24.232064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a897f33-31fc-4eec-8b98-8302395176ee None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:24.232064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a897f33-31fc-4eec-8b98-8302395176ee None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:24.233414 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 522/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:24.239461 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda375-d612-44d1-a3e3-b357cbcdd487 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:24.240197 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda375-d612-44d1-a3e3-b357cbcdd487 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:24.240402 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda375-d612-44d1-a3e3-b357cbcdd487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:24.270595 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-6cfda375-d612-44d1-a3e3-b357cbcdd487 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:24.271825 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-6cfda375-d612-44d1-a3e3-b357cbcdd487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:24.285899 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 513/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:24.515293 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a897f33-31fc-4eec-8b98-8302395176ee None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:24.531434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a897f33-31fc-4eec-8b98-8302395176ee None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:24.537699 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7104c-080b-43cd-aef9-5b79529a0f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:24.538308 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7104c-080b-43cd-aef9-5b79529a0f2b service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:24.538581 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7104c-080b-43cd-aef9-5b79529a0f2b service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:24.538844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7104c-080b-43cd-aef9-5b79529a0f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:24.548496 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7104c-080b-43cd-aef9-5b79529a0f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:24.550138 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7104c-080b-43cd-aef9-5b79529a0f2b service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:24.560070 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 523/1036] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:25.490368 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383e0b0-8102-4374-ac64-19890111a81c None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:25.491225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383e0b0-8102-4374-ac64-19890111a81c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:25.491225 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383e0b0-8102-4374-ac64-19890111a81c None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:25.493202 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 514/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:25.499625 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334c735-e385-4db8-8ac2-9b562b5bf554 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:25.500103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334c735-e385-4db8-8ac2-9b562b5bf554 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:25.500103 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334c735-e385-4db8-8ac2-9b562b5bf554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:25.521415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-a334c735-e385-4db8-8ac2-9b562b5bf554 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:25.522593 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-a334c735-e385-4db8-8ac2-9b562b5bf554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:25.532511 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 524/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:25.702983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383e0b0-8102-4374-ac64-19890111a81c None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:25.722864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383e0b0-8102-4374-ac64-19890111a81c None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:25.729882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eae35-be46-472b-b296-1122ae645580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:25.730496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eae35-be46-472b-b296-1122ae645580 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:25.730861 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eae35-be46-472b-b296-1122ae645580 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:25.731213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eae35-be46-472b-b296-1122ae645580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:25.739667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eae35-be46-472b-b296-1122ae645580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:25.741301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eae35-be46-472b-b296-1122ae645580 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:25.750847 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 515/1039] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:26.623568 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa502d8-6494-47ae-949b-9fb785bbd77a None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:26.624506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa502d8-6494-47ae-949b-9fb785bbd77a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:26.624506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa502d8-6494-47ae-949b-9fb785bbd77a None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:26.625681 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 525/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:26.633569 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5efde-05b7-4247-b9bc-8862d5c5f1e7 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:26.634447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5efde-05b7-4247-b9bc-8862d5c5f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:26.634447 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5efde-05b7-4247-b9bc-8862d5c5f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:26.656771 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-9aa5efde-05b7-4247-b9bc-8862d5c5f1e7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:26.657952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-9aa5efde-05b7-4247-b9bc-8862d5c5f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:26.665970 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 516/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:45:26.822067 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa502d8-6494-47ae-949b-9fb785bbd77a None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:26.844545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa502d8-6494-47ae-949b-9fb785bbd77a None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:26.850965 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96650461-73bf-4dba-b96d-9acc629046dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:26.851571 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650461-73bf-4dba-b96d-9acc629046dd service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:26.851846 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650461-73bf-4dba-b96d-9acc629046dd service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:26.852110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650461-73bf-4dba-b96d-9acc629046dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:26.861381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650461-73bf-4dba-b96d-9acc629046dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:26.862976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650461-73bf-4dba-b96d-9acc629046dd service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:26.873366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 526/1042] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:27.765654 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93a61c-1090-4e68-bdad-000663a80d67 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:27.766249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93a61c-1090-4e68-bdad-000663a80d67 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:27.766249 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93a61c-1090-4e68-bdad-000663a80d67 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:27.767511 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 517/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:27.773765 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f411787-9cb2-4670-bc14-de60e5cdff69 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:27.774441 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f411787-9cb2-4670-bc14-de60e5cdff69 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:27.774717 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f411787-9cb2-4670-bc14-de60e5cdff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:27.796516 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-5f411787-9cb2-4670-bc14-de60e5cdff69 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:27.797749 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-5f411787-9cb2-4670-bc14-de60e5cdff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:27.806838 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 527/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:27.966086 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93a61c-1090-4e68-bdad-000663a80d67 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:27.987375 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93a61c-1090-4e68-bdad-000663a80d67 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:27.993275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcc35f-7191-4695-aadd-4f1807e0f2a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:27.993869 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc35f-7191-4695-aadd-4f1807e0f2a0 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:27.994139 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc35f-7191-4695-aadd-4f1807e0f2a0 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:27.994401 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc35f-7191-4695-aadd-4f1807e0f2a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:28.002988 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcc35f-7191-4695-aadd-4f1807e0f2a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:28.004566 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcc35f-7191-4695-aadd-4f1807e0f2a0 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:28.014030 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 518/1045] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:28.844299 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f5640-fd76-456d-a0b7-cba2e461a1b0 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:28.844804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f5640-fd76-456d-a0b7-cba2e461a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:28.844920 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f5640-fd76-456d-a0b7-cba2e461a1b0 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:28.846227 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 528/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:28.852217 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606577b-acac-43a1-aed1-ab4e10d60c32 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:28.853069 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606577b-acac-43a1-aed1-ab4e10d60c32 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:28.853218 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606577b-acac-43a1-aed1-ab4e10d60c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:28.874591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-5606577b-acac-43a1-aed1-ab4e10d60c32 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:28.875784 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-5606577b-acac-43a1-aed1-ab4e10d60c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:28.884552 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 519/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:29.041167 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f5640-fd76-456d-a0b7-cba2e461a1b0 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:29.062536 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f5640-fd76-456d-a0b7-cba2e461a1b0 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:29.069491 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d59a0-66ea-42b0-923a-8406f815afd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:29.070106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d59a0-66ea-42b0-923a-8406f815afd2 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:29.070380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d59a0-66ea-42b0-923a-8406f815afd2 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:29.070637 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d59a0-66ea-42b0-923a-8406f815afd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:29.079819 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d59a0-66ea-42b0-923a-8406f815afd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:29.081457 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d59a0-66ea-42b0-923a-8406f815afd2 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:29.091512 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 529/1048] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:29.904994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d32e8-54ac-48ae-a8a0-750476b0f5ce None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:29.905557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d32e8-54ac-48ae-a8a0-750476b0f5ce None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:29.905557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d32e8-54ac-48ae-a8a0-750476b0f5ce None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:29.906884 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 520/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:29.912885 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469352f-0688-426c-9355-3e16f2894f75 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:29.913368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469352f-0688-426c-9355-3e16f2894f75 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:29.913480 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469352f-0688-426c-9355-3e16f2894f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:29.941693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c469352f-0688-426c-9355-3e16f2894f75 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:29.942886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c469352f-0688-426c-9355-3e16f2894f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:29.952194 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 530/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:30.125365 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d32e8-54ac-48ae-a8a0-750476b0f5ce None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:30.140654 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d32e8-54ac-48ae-a8a0-750476b0f5ce None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:30.145740 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad319a30-f970-442a-9199-fc7cf0c5d551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:30.146356 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319a30-f970-442a-9199-fc7cf0c5d551 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:30.146627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319a30-f970-442a-9199-fc7cf0c5d551 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:30.146889 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319a30-f970-442a-9199-fc7cf0c5d551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:30.154936 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad319a30-f970-442a-9199-fc7cf0c5d551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:30.156693 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad319a30-f970-442a-9199-fc7cf0c5d551 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:30.166024 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 521/1051] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:30.979931 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f527-0834-48d7-a94b-7fced3af0de1 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:30.980783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f527-0834-48d7-a94b-7fced3af0de1 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:30.980783 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f527-0834-48d7-a94b-7fced3af0de1 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:30.982138 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 531/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:30.987808 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386303f-25ce-47c7-abbe-23dc07d66162 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:30.988277 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386303f-25ce-47c7-abbe-23dc07d66162 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:30.988380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386303f-25ce-47c7-abbe-23dc07d66162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:31.008917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-6386303f-25ce-47c7-abbe-23dc07d66162 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:31.010115 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-6386303f-25ce-47c7-abbe-23dc07d66162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:31.019651 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 522/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:31.179499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f527-0834-48d7-a94b-7fced3af0de1 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:31.202320 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f527-0834-48d7-a94b-7fced3af0de1 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:31.208776 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556400ec-f15a-43f5-a62a-7a543179654a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:31.209395 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556400ec-f15a-43f5-a62a-7a543179654a service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:31.209672 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556400ec-f15a-43f5-a62a-7a543179654a service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:31.209932 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556400ec-f15a-43f5-a62a-7a543179654a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:31.218680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556400ec-f15a-43f5-a62a-7a543179654a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:31.220278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556400ec-f15a-43f5-a62a-7a543179654a service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:31.229912 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 532/1054] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:32.072379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899b85-c2eb-4244-b479-8c7aea3bc6b8 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:32.072999 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899b85-c2eb-4244-b479-8c7aea3bc6b8 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:32.072999 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899b85-c2eb-4244-b479-8c7aea3bc6b8 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:32.074286 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 523/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:32.080373 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c498-fd53-400a-a40d-4d831f3ecbe1 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:32.081175 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c498-fd53-400a-a40d-4d831f3ecbe1 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:32.081326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c498-fd53-400a-a40d-4d831f3ecbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:32.105505 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-4e89c498-fd53-400a-a40d-4d831f3ecbe1 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:32.106871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4e89c498-fd53-400a-a40d-4d831f3ecbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:32.115877 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 533/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:45:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:32.270914 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61899b85-c2eb-4244-b479-8c7aea3bc6b8 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:32.287535 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61899b85-c2eb-4244-b479-8c7aea3bc6b8 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:32.292795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792ba4f-4870-4b15-b835-86d1dcf684c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:32.293539 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792ba4f-4870-4b15-b835-86d1dcf684c7 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:32.293921 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792ba4f-4870-4b15-b835-86d1dcf684c7 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:32.294195 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792ba4f-4870-4b15-b835-86d1dcf684c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:32.302451 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792ba4f-4870-4b15-b835-86d1dcf684c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:32.304022 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792ba4f-4870-4b15-b835-86d1dcf684c7 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:32.313214 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 524/1057] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:34.360411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74bab-8395-4818-8dd1-aa49797c63c0 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:34.361036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74bab-8395-4818-8dd1-aa49797c63c0 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:34.361036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74bab-8395-4818-8dd1-aa49797c63c0 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:34.363241 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 534/1058] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:34.371489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5644382-cae2-4d8f-b536-13207aa8abe8 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:34.372033 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5644382-cae2-4d8f-b536-13207aa8abe8 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:34.372033 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5644382-cae2-4d8f-b536-13207aa8abe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:34.392986 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-b5644382-cae2-4d8f-b536-13207aa8abe8 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:34.394184 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b5644382-cae2-4d8f-b536-13207aa8abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:34.402900 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 525/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:34.751172 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74bab-8395-4818-8dd1-aa49797c63c0 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:34.763599 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74bab-8395-4818-8dd1-aa49797c63c0 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:34.768080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6092-26d9-4576-abf8-0a63dc0d8a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:34.768674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6092-26d9-4576-abf8-0a63dc0d8a5c service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:34.768971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6092-26d9-4576-abf8-0a63dc0d8a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:34.769238 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6092-26d9-4576-abf8-0a63dc0d8a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:34.778817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c6092-26d9-4576-abf8-0a63dc0d8a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:34.780254 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c6092-26d9-4576-abf8-0a63dc0d8a5c service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:34.789985 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 535/1060] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:37.206690 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4400-2517-4e55-b337-c666aefb6a5c None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:37.207265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4400-2517-4e55-b337-c666aefb6a5c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:37.207265 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4400-2517-4e55-b337-c666aefb6a5c None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:37.208584 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 526/1061] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:37.214981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b197e-9f44-4be5-8af0-b96d08d9b87a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:37.215690 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b197e-9f44-4be5-8af0-b96d08d9b87a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:37.215850 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b197e-9f44-4be5-8af0-b96d08d9b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:37.242723 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-be1b197e-9f44-4be5-8af0-b96d08d9b87a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:37.243938 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-be1b197e-9f44-4be5-8af0-b96d08d9b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:37.253385 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 536/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:37.589264 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d4400-2517-4e55-b337-c666aefb6a5c None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:37.605698 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d4400-2517-4e55-b337-c666aefb6a5c None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:37.609906 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768959c3-bb7d-482e-bc73-d363cd5c35c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:37.610589 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768959c3-bb7d-482e-bc73-d363cd5c35c2 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:37.610860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768959c3-bb7d-482e-bc73-d363cd5c35c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:37.611117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768959c3-bb7d-482e-bc73-d363cd5c35c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:37.621416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768959c3-bb7d-482e-bc73-d363cd5c35c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:37.622868 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768959c3-bb7d-482e-bc73-d363cd5c35c2 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:37.632815 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 527/1063] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:40.141049 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3548a-6d76-49ab-aa6a-af6df71fdaf1 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:40.141933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3548a-6d76-49ab-aa6a-af6df71fdaf1 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:40.141933 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3548a-6d76-49ab-aa6a-af6df71fdaf1 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:40.144000 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 537/1064] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:40.153278 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8b8f-4fcb-44c7-99b1-a10044ae7326 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:40.153691 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8b8f-4fcb-44c7-99b1-a10044ae7326 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:40.153785 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8b8f-4fcb-44c7-99b1-a10044ae7326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:40.178379 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-001e8b8f-4fcb-44c7-99b1-a10044ae7326 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:40.179555 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-001e8b8f-4fcb-44c7-99b1-a10044ae7326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:40.187770 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 528/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:40.531569 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3548a-6d76-49ab-aa6a-af6df71fdaf1 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:40.544879 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3548a-6d76-49ab-aa6a-af6df71fdaf1 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:40.549324 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fdf3d-69db-4539-883e-094e7fb197cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:40.549946 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fdf3d-69db-4539-883e-094e7fb197cf service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:40.550221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fdf3d-69db-4539-883e-094e7fb197cf service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:40.550489 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fdf3d-69db-4539-883e-094e7fb197cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:40.560241 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fdf3d-69db-4539-883e-094e7fb197cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:40.561697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fdf3d-69db-4539-883e-094e7fb197cf service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:40.571823 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 538/1066] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:42.907942 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbf99b-d0ee-4893-a89c-e2d20d206abd None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:42.908820 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbf99b-d0ee-4893-a89c-e2d20d206abd None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:42.908987 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbf99b-d0ee-4893-a89c-e2d20d206abd None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:42.911051 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 529/1067] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:42.916888 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241556-5cea-4c2b-a5d0-83b642165c04 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:42.917308 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241556-5cea-4c2b-a5d0-83b642165c04 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:42.917415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241556-5cea-4c2b-a5d0-83b642165c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:42.937072 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-05241556-5cea-4c2b-a5d0-83b642165c04 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:42.938262 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-05241556-5cea-4c2b-a5d0-83b642165c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:42.946867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 539/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:43.287888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbf99b-d0ee-4893-a89c-e2d20d206abd None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:43.305921 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbf99b-d0ee-4893-a89c-e2d20d206abd None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:43.311418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ca97d-d439-4c1d-8f64-116e5aacc680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:43.312013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca97d-d439-4c1d-8f64-116e5aacc680 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:43.312283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca97d-d439-4c1d-8f64-116e5aacc680 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:43.312660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca97d-d439-4c1d-8f64-116e5aacc680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:43.322419 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ca97d-d439-4c1d-8f64-116e5aacc680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:43.323882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ca97d-d439-4c1d-8f64-116e5aacc680 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:43.333434 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 530/1069] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:45.579076 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fc792-af8d-4c5e-b593-d7e01fbeab0e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:45.579656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fc792-af8d-4c5e-b593-d7e01fbeab0e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:45.579656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fc792-af8d-4c5e-b593-d7e01fbeab0e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:45.581020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 540/1070] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:45.587555 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97357-2d3f-427c-b0bb-9a1e4a96bf63 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:45.588275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97357-2d3f-427c-b0bb-9a1e4a96bf63 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:45.588538 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97357-2d3f-427c-b0bb-9a1e4a96bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:45.597439 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=61 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:45.611659 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-32e97357-2d3f-427c-b0bb-9a1e4a96bf63 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:45.612979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-32e97357-2d3f-427c-b0bb-9a1e4a96bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:45.621430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 531/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:45.969710 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fc792-af8d-4c5e-b593-d7e01fbeab0e None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:45.980027 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=64 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:45.986937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fc792-af8d-4c5e-b593-d7e01fbeab0e None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:45.990658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080cc7-9502-4658-93b5-fcee307a590b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:45.991251 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080cc7-9502-4658-93b5-fcee307a590b service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:45.991521 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080cc7-9502-4658-93b5-fcee307a590b service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:45.991785 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080cc7-9502-4658-93b5-fcee307a590b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:46.001091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7080cc7-9502-4658-93b5-fcee307a590b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:46.002508 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7080cc7-9502-4658-93b5-fcee307a590b service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:46.011985 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 541/1072] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:48.289072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505adf1f-c835-434f-b0b6-8f41de13a743 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:48.289672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505adf1f-c835-434f-b0b6-8f41de13a743 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:48.289672 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505adf1f-c835-434f-b0b6-8f41de13a743 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:48.290943 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 532/1073] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:48.297548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e545-dd08-454e-8333-40d137d1ba69 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:48.297991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e545-dd08-454e-8333-40d137d1ba69 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:48.298112 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e545-dd08-454e-8333-40d137d1ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:48.327804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-fb43e545-dd08-454e-8333-40d137d1ba69 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:48.329079 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-fb43e545-dd08-454e-8333-40d137d1ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:48.338105 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 542/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:48.678562 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505adf1f-c835-434f-b0b6-8f41de13a743 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:48.693888 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505adf1f-c835-434f-b0b6-8f41de13a743 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:48.698205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995aa2-fb14-4d8e-81df-4550cd84d67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:48.698802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995aa2-fb14-4d8e-81df-4550cd84d67e service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:48.699636 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995aa2-fb14-4d8e-81df-4550cd84d67e service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:48.699923 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995aa2-fb14-4d8e-81df-4550cd84d67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:48.710133 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995aa2-fb14-4d8e-81df-4550cd84d67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:48.711608 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995aa2-fb14-4d8e-81df-4550cd84d67e service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:48.721816 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 533/1075] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:50.953833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a4387-3415-44db-a2cc-afcd3ed55c4b None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:50.954813 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a4387-3415-44db-a2cc-afcd3ed55c4b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:50.954813 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a4387-3415-44db-a2cc-afcd3ed55c4b None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:50.956668 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 543/1076] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:50.965163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafaa7-e790-43dd-ae27-220583be2ff1 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:50.965640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafaa7-e790-43dd-ae27-220583be2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:50.965731 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafaa7-e790-43dd-ae27-220583be2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:50.986011 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-e4eafaa7-e790-43dd-ae27-220583be2ff1 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:50.987188 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-e4eafaa7-e790-43dd-ae27-220583be2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:50.995193 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 534/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:51.330309 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a4387-3415-44db-a2cc-afcd3ed55c4b None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:51.347665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a4387-3415-44db-a2cc-afcd3ed55c4b None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:51.351868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c23ed-c933-419e-a17d-3b57ed8ce279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:51.352490 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c23ed-c933-419e-a17d-3b57ed8ce279 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:51.352792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c23ed-c933-419e-a17d-3b57ed8ce279 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:51.353055 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c23ed-c933-419e-a17d-3b57ed8ce279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:51.363190 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c23ed-c933-419e-a17d-3b57ed8ce279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:51.364639 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c23ed-c933-419e-a17d-3b57ed8ce279 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:51.374200 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 544/1078] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:53.612946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451d67d-3189-45d4-a327-4fcc9c72142b None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:53.613713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451d67d-3189-45d4-a327-4fcc9c72142b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:53.613713 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451d67d-3189-45d4-a327-4fcc9c72142b None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:53.615893 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 535/1079] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:53.624239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8491f-f7c0-4286-924f-96cc8d74d2e7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:53.624727 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8491f-f7c0-4286-924f-96cc8d74d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:53.624824 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8491f-f7c0-4286-924f-96cc8d74d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:53.645082 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-3aa8491f-f7c0-4286-924f-96cc8d74d2e7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:53.646277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-3aa8491f-f7c0-4286-924f-96cc8d74d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:53.654747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 545/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:53.997732 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451d67d-3189-45d4-a327-4fcc9c72142b None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:54.016168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451d67d-3189-45d4-a327-4fcc9c72142b None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:54.022152 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d7d6-7db0-43e9-a041-160c50c9424e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:54.023090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d7d6-7db0-43e9-a041-160c50c9424e service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:54.023547 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d7d6-7db0-43e9-a041-160c50c9424e service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:54.023995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d7d6-7db0-43e9-a041-160c50c9424e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:54.035025 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860d7d6-7db0-43e9-a041-160c50c9424e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:54.036465 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860d7d6-7db0-43e9-a041-160c50c9424e service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:54.046848 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 536/1081] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:56.231105 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9812a-e5be-4f47-b556-d04fe19bfbef None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:56.232001 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9812a-e5be-4f47-b556-d04fe19bfbef None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:56.232001 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9812a-e5be-4f47-b556-d04fe19bfbef None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:56.234259 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 546/1082] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:56.240658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af1b5-6b76-467d-bfd8-16454926db91 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:56.241322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af1b5-6b76-467d-bfd8-16454926db91 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:56.241553 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af1b5-6b76-467d-bfd8-16454926db91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:56.262892 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-3f4af1b5-6b76-467d-bfd8-16454926db91 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:56.264096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-3f4af1b5-6b76-467d-bfd8-16454926db91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:56.272375 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 537/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:56.613314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9812a-e5be-4f47-b556-d04fe19bfbef None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:56.633014 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9812a-e5be-4f47-b556-d04fe19bfbef None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:56.638427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3315d7-db9d-49a3-af63-a8100bbd4fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:56.639040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3315d7-db9d-49a3-af63-a8100bbd4fea service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:56.639315 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3315d7-db9d-49a3-af63-a8100bbd4fea service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:56.639578 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3315d7-db9d-49a3-af63-a8100bbd4fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:56.649064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3315d7-db9d-49a3-af63-a8100bbd4fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:56.650519 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3315d7-db9d-49a3-af63-a8100bbd4fea service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:56.659934 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 547/1084] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:45:58.859730 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd8a46-d771-49c7-9767-6524c5f6c681 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:58.860224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd8a46-d771-49c7-9767-6524c5f6c681 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:58.860319 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd8a46-d771-49c7-9767-6524c5f6c681 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:58.862568 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 538/1085] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:45:58.870135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013882a-7729-458c-8406-08ccdc51e4b4 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:58.870853 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013882a-7729-458c-8406-08ccdc51e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:58.871100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013882a-7729-458c-8406-08ccdc51e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:58.897309 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-6013882a-7729-458c-8406-08ccdc51e4b4 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:45:58.898520 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-6013882a-7729-458c-8406-08ccdc51e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:45:58.907399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 548/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:45:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:45:59.249635 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd8a46-d771-49c7-9767-6524c5f6c681 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:45:59.264196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd8a46-d771-49c7-9767-6524c5f6c681 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:45:59.268518 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3584-a80f-4957-810a-40f61e38ab6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:45:59.269160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3584-a80f-4957-810a-40f61e38ab6d service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:45:59.269435 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3584-a80f-4957-810a-40f61e38ab6d service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:45:59.269699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3584-a80f-4957-810a-40f61e38ab6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:45:59.281261 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3584-a80f-4957-810a-40f61e38ab6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:45:59.282703 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3584-a80f-4957-810a-40f61e38ab6d service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:45:59.292548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 539/1087] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:45:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:46:08.892175 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=26 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:09.288158 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=26 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:23.132324 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c22a-da5c-4ed0-bc72-6727cd16c30e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:23.132893 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c22a-da5c-4ed0-bc72-6727cd16c30e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:23.132893 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c22a-da5c-4ed0-bc72-6727cd16c30e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:23.134163 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 549/1088] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:23.140806 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6032cc-c6bd-4a20-a32f-181b3c25c02c None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:23.141560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6032cc-c6bd-4a20-a32f-181b3c25c02c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:23.141714 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6032cc-c6bd-4a20-a32f-181b3c25c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:23.173372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-fc6032cc-c6bd-4a20-a32f-181b3c25c02c None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:23.174788 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-fc6032cc-c6bd-4a20-a32f-181b3c25c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:23.185681 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 540/1089] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:46:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:46:23.561206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240aa5-4003-4a22-95f5-3350d364424e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:23.561488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240aa5-4003-4a22-95f5-3350d364424e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:23.561762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240aa5-4003-4a22-95f5-3350d364424e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:23.563114 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 550/1090] 10.222.0.59 () {54 vars in 967 bytes} [Mon Aug 22 17:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:23.571709 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343458-a0d4-43e8-9fb1-be52e1a2540b None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:23.572126 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343458-a0d4-43e8-9fb1-be52e1a2540b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:23.572575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343458-a0d4-43e8-9fb1-be52e1a2540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:23.593523 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-64343458-a0d4-43e8-9fb1-be52e1a2540b None None] MFA Rules not processed for user `a0b91ae7fe5246bb9bb838bc5a4cc099`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:23.594726 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-64343458-a0d4-43e8-9fb1-be52e1a2540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:23.601988 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 541/1091] 10.222.0.59 () {58 vars in 1064 bytes} [Mon Aug 22 17:46:23 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:46:23.609651 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51240aa5-4003-4a22-95f5-3350d364424e None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:46:23.620457 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51240aa5-4003-4a22-95f5-3350d364424e None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:46:23.624046 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1898e12-3172-4c4e-94b0-c9e35b8c604f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b91ae7fe5246bb9bb838bc5a4cc099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:46:23.624636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898e12-3172-4c4e-94b0-c9e35b8c604f service glance] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:23.624949 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898e12-3172-4c4e-94b0-c9e35b8c604f service glance] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:23.625216 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898e12-3172-4c4e-94b0-c9e35b8c604f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:23.634099 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1898e12-3172-4c4e-94b0-c9e35b8c604f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:46:23.635631 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1898e12-3172-4c4e-94b0-c9e35b8c604f service glance] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:46:23.645165 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 551/1092] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:46:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:46:25.917107 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b6d0-b1f7-4d93-a9d6-04f9c7564e5d None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:25.917694 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b6d0-b1f7-4d93-a9d6-04f9c7564e5d None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:25.917694 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b6d0-b1f7-4d93-a9d6-04f9c7564e5d None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:25.919168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 542/1093] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:25.927597 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351dfc-9105-4dc1-b2d8-2ee791ee9d4a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:25.928074 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351dfc-9105-4dc1-b2d8-2ee791ee9d4a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:25.928181 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351dfc-9105-4dc1-b2d8-2ee791ee9d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:25.955535 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-b8351dfc-9105-4dc1-b2d8-2ee791ee9d4a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:25.956747 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-b8351dfc-9105-4dc1-b2d8-2ee791ee9d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:25.965938 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 552/1094] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:46:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:46:26.306604 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b6d0-b1f7-4d93-a9d6-04f9c7564e5d None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:46:26.321536 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b6d0-b1f7-4d93-a9d6-04f9c7564e5d None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:46:26.326730 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fef51-9e54-4256-b76c-5466d38d3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:46:26.327354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fef51-9e54-4256-b76c-5466d38d3628 admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:26.327632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fef51-9e54-4256-b76c-5466d38d3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:26.327928 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fef51-9e54-4256-b76c-5466d38d3628 admin admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:26.328588 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fef51-9e54-4256-b76c-5466d38d3628 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:46:26.330376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-6d4fef51-9e54-4256-b76c-5466d38d3628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:46:26.330376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 17:46:26.330376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 17:46:26.331519 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fef51-9e54-4256-b76c-5466d38d3628 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:46:26.349400 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 543/1095] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Aug 22 17:46:26 2022] GET /identity/v3/projects => generated 1606 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:46:28.542893 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f80422-73f8-4be1-84f1-cde32e6d28d9 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:28.543791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f80422-73f8-4be1-84f1-cde32e6d28d9 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:28.543791 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f80422-73f8-4be1-84f1-cde32e6d28d9 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:28.546017 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 553/1096] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:28.553831 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c269d5-b37f-42b0-b049-079ffd6fefbb None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:28.554301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c269d5-b37f-42b0-b049-079ffd6fefbb None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:28.554401 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c269d5-b37f-42b0-b049-079ffd6fefbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:28.574762 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-37c269d5-b37f-42b0-b049-079ffd6fefbb None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:28.575975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-37c269d5-b37f-42b0-b049-079ffd6fefbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:28.588141 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 544/1097] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:46:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:46:28.939638 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f80422-73f8-4be1-84f1-cde32e6d28d9 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:46:28.954121 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f80422-73f8-4be1-84f1-cde32e6d28d9 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:46:28.959659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4543798-e22a-4e80-bd8d-2218e26b7236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:46:28.961741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4543798-e22a-4e80-bd8d-2218e26b7236 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:28.961741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4543798-e22a-4e80-bd8d-2218e26b7236 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:28.961741 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4543798-e22a-4e80-bd8d-2218e26b7236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:28.969572 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4543798-e22a-4e80-bd8d-2218e26b7236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:46:28.971148 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4543798-e22a-4e80-bd8d-2218e26b7236 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:46:28.981038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 554/1098] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:46:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:46:31.332824 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da678-5f9d-4123-9688-e3fa6982ced4 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:31.333688 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da678-5f9d-4123-9688-e3fa6982ced4 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:31.333688 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da678-5f9d-4123-9688-e3fa6982ced4 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:31.335827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 545/1099] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:46:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:31.341366 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2651b8-a614-4c4c-bb55-de0c6f77a434 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:31.341806 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2651b8-a614-4c4c-bb55-de0c6f77a434 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:31.341911 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2651b8-a614-4c4c-bb55-de0c6f77a434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:31.362412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-3d2651b8-a614-4c4c-bb55-de0c6f77a434 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:31.363617 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-3d2651b8-a614-4c4c-bb55-de0c6f77a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:31.373276 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 555/1100] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:46:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:46:31.711419 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4da678-5f9d-4123-9688-e3fa6982ced4 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:46:31.724320 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4da678-5f9d-4123-9688-e3fa6982ced4 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:46:31.730476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe640f8-105c-4724-9d68-9ec9bf7fa9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:46:31.731081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe640f8-105c-4724-9d68-9ec9bf7fa9fc service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:31.731354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe640f8-105c-4724-9d68-9ec9bf7fa9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:31.731620 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe640f8-105c-4724-9d68-9ec9bf7fa9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:31.741631 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe640f8-105c-4724-9d68-9ec9bf7fa9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:46:31.743073 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe640f8-105c-4724-9d68-9ec9bf7fa9fc service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:46:31.752788 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 546/1101] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:46:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:46:34.014434 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3de32f-e6ca-4a23-b68f-6a3f096846f8 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:34.015203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3de32f-e6ca-4a23-b68f-6a3f096846f8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:34.015203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3de32f-e6ca-4a23-b68f-6a3f096846f8 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:34.016325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 556/1102] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:34.022730 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818a2b-306e-416a-b0d4-ac20be25c1ee None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:34.023448 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818a2b-306e-416a-b0d4-ac20be25c1ee None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:34.023738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818a2b-306e-416a-b0d4-ac20be25c1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:34.051198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-07818a2b-306e-416a-b0d4-ac20be25c1ee None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:34.052386 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-07818a2b-306e-416a-b0d4-ac20be25c1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:34.061541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 547/1103] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:46:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:46:34.413664 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3de32f-e6ca-4a23-b68f-6a3f096846f8 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:46:34.425934 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3de32f-e6ca-4a23-b68f-6a3f096846f8 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:46:34.430059 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8510a9-29a2-48c4-9dea-26a4fc241b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:46:34.430655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8510a9-29a2-48c4-9dea-26a4fc241b3a service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:34.430925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8510a9-29a2-48c4-9dea-26a4fc241b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:34.431214 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8510a9-29a2-48c4-9dea-26a4fc241b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:34.441671 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8510a9-29a2-48c4-9dea-26a4fc241b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:46:34.443095 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8510a9-29a2-48c4-9dea-26a4fc241b3a service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:46:34.453132 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 557/1104] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:46:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:46:36.792849 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c10592-9d97-4d61-9fe7-71468ee6db1e None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:36.793768 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c10592-9d97-4d61-9fe7-71468ee6db1e None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:36.793768 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c10592-9d97-4d61-9fe7-71468ee6db1e None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:36.796034 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 548/1105] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:46:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:36.804243 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffbbd2-d5d3-4e3c-94c9-a45b97539101 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:36.804723 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffbbd2-d5d3-4e3c-94c9-a45b97539101 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:36.804835 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffbbd2-d5d3-4e3c-94c9-a45b97539101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:36.825648 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-28ffbbd2-d5d3-4e3c-94c9-a45b97539101 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:36.826867 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-28ffbbd2-d5d3-4e3c-94c9-a45b97539101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:36.836548 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 558/1106] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:46:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:46:37.194033 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c10592-9d97-4d61-9fe7-71468ee6db1e None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:46:37.207632 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c10592-9d97-4d61-9fe7-71468ee6db1e None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:46:37.218163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311f135-d172-4496-800a-8bca9cd2a3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:46:37.218800 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f135-d172-4496-800a-8bca9cd2a3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:37.219077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f135-d172-4496-800a-8bca9cd2a3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:37.219343 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f135-d172-4496-800a-8bca9cd2a3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:37.229959 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311f135-d172-4496-800a-8bca9cd2a3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:46:37.231512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311f135-d172-4496-800a-8bca9cd2a3d9 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:46:37.241174 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 549/1107] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:46:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:46:39.644476 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df72b-eb19-499b-8927-ced24abb5e6e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:39.645422 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df72b-eb19-499b-8927-ced24abb5e6e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:39.645422 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df72b-eb19-499b-8927-ced24abb5e6e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:39.647918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 559/1108] 10.222.0.59 () {54 vars in 927 bytes} [Mon Aug 22 17:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:46:39.653090 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddda896-eba9-4061-a883-3b1c23fb8987 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:39.653544 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddda896-eba9-4061-a883-3b1c23fb8987 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:39.653660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddda896-eba9-4061-a883-3b1c23fb8987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:39.672890 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-eddda896-eba9-4061-a883-3b1c23fb8987 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:46:39.674081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-eddda896-eba9-4061-a883-3b1c23fb8987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:46:39.682416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 550/1109] 10.222.0.59 () {58 vars in 1024 bytes} [Mon Aug 22 17:46:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:46:40.032126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09df72b-eb19-499b-8927-ced24abb5e6e None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:46:40.045934 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09df72b-eb19-499b-8927-ced24abb5e6e None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:46:40.049844 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1421f5-9277-4957-b6ba-f87cbcae9f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:46:40.050440 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1421f5-9277-4957-b6ba-f87cbcae9f02 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:46:40.050712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1421f5-9277-4957-b6ba-f87cbcae9f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:46:40.050976 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1421f5-9277-4957-b6ba-f87cbcae9f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:46:40.061014 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1421f5-9277-4957-b6ba-f87cbcae9f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:46:40.062442 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1421f5-9277-4957-b6ba-f87cbcae9f02 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:46:40.072034 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 560/1110] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:46:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:46:49.668358 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=33 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:50.067998 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=33 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:00.644128 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8b6e5-cc69-405d-b368-1362e587724a None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:00.645180 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8b6e5-cc69-405d-b368-1362e587724a None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:00.645180 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8b6e5-cc69-405d-b368-1362e587724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:00.668791 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-87d8b6e5-cc69-405d-b368-1362e587724a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:48:00.669995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-87d8b6e5-cc69-405d-b368-1362e587724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:48:00.679758 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 551/1111] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:48:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:48:00.691780 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44bca1-3fe7-4103-bc70-2681550d8f23 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:00.692315 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44bca1-3fe7-4103-bc70-2681550d8f23 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:00.692315 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44bca1-3fe7-4103-bc70-2681550d8f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:00.718445 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-6f44bca1-3fe7-4103-bc70-2681550d8f23 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:48:00.719605 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-6f44bca1-3fe7-4103-bc70-2681550d8f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:48:00.729039 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 561/1112] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:48:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:48:00.733715 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8b6e5-cc69-405d-b368-1362e587724a None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:00.744118 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8b6e5-cc69-405d-b368-1362e587724a None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:00.749579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:00.750176 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:00.750452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:00.750719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:00.751363 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:48:00.751660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:00.752738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:00.752738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 17:48:00.752738 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 17:48:00.753610 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:00.765592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 552/1113] 10.222.0.59 () {58 vars in 1153 bytes} [Mon Aug 22 17:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:48:00.773965 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44bca1-3fe7-4103-bc70-2681550d8f23 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:00.782993 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44bca1-3fe7-4103-bc70-2681550d8f23 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:00.787679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:00.788267 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:00.788677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:00.789173 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:00.789884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:00.791689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING py.warnings [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:00.791689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: warnings.warn(msg) Aug 22 17:48:00.791689 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: Aug 22 17:48:00.792913 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:00.824355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 562/1114] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Aug 22 17:48:00 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:48:00.829398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:00.842032 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211eae-f1dd-47a4-91a3-4496dc91d73c admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:00.904755 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:00.905482 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:00.905817 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:00.906208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:00.907170 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:00.908859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:00.908859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 17:48:00.908859 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 17:48:00.910686 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:00.934929 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 553/1115] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:48:00 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:48:00.940315 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:00.950957 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8f99-1ffb-46fa-ac55-a8da675c153c admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:00.956390 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:00.957048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:00.957319 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:00.957560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:00.958246 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:00.959272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING py.warnings [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:00.959272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: warnings.warn(msg) Aug 22 17:48:00.959272 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: Aug 22 17:48:00.960197 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:00.973138 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 563/1116] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:48:00.977445 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:00.988248 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9d324-5944-4f37-aba1-a50e90ada60e admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:00.993498 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f5831-2612-47a7-833e-e30a53593558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:00.994201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5831-2612-47a7-833e-e30a53593558 admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:00.994503 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5831-2612-47a7-833e-e30a53593558 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:00.995208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5831-2612-47a7-833e-e30a53593558 admin admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:00.995380 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5831-2612-47a7-833e-e30a53593558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:00.996454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-920f5831-2612-47a7-833e-e30a53593558 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:00.996454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 17:48:00.996454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 17:48:00.997464 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5831-2612-47a7-833e-e30a53593558 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:01.012577 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 554/1117] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:48:01.016724 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:01.027346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264df139-cb5e-406d-88b2-024b0abf06a6 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:01.032146 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d22512-8e5c-4a1a-8dfc-79e0030f1edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:01.032823 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22512-8e5c-4a1a-8dfc-79e0030f1edd admin admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.033100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22512-8e5c-4a1a-8dfc-79e0030f1edd admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.033370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22512-8e5c-4a1a-8dfc-79e0030f1edd admin admin] PATH_INFO: `/v3/projects/c7e20d6138e14f3ca8ffd918024d2475/users/4646d0785ca84e29b4faf2317b43ed79/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.048601 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d22512-8e5c-4a1a-8dfc-79e0030f1edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e20d6138e14f3ca8ffd918024d2475, user_id=4646d0785ca84e29b4faf2317b43ed79, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:01.049695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING py.warnings [None req-93d22512-8e5c-4a1a-8dfc-79e0030f1edd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:01.049695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: warnings.warn(msg) Aug 22 17:48:01.049695 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: Aug 22 17:48:01.051641 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d22512-8e5c-4a1a-8dfc-79e0030f1edd admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:01.067899 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 564/1118] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Aug 22 17:48:01 2022] PUT /identity/v3/projects/c7e20d6138e14f3ca8ffd918024d2475/users/4646d0785ca84e29b4faf2317b43ed79/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:48:01.080376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f52b9-26d3-4fb6-9dfc-87d34fb423a8 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.080690 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f52b9-26d3-4fb6-9dfc-87d34fb423a8 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.080966 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f52b9-26d3-4fb6-9dfc-87d34fb423a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.111697 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-378f52b9-26d3-4fb6-9dfc-87d34fb423a8 None None] MFA Rules not processed for user `4646d0785ca84e29b4faf2317b43ed79`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:48:01.112958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-378f52b9-26d3-4fb6-9dfc-87d34fb423a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:48:01.182531 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 555/1119] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:48:01 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:48:01.197843 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041302-2c83-4b8a-9d0e-c6863e654f9b None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.198128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041302-2c83-4b8a-9d0e-c6863e654f9b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.198395 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041302-2c83-4b8a-9d0e-c6863e654f9b None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.199740 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 565/1120] 10.222.0.59 () {54 vars in 964 bytes} [Mon Aug 22 17:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:48:01.204597 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6568-b845-456e-9dda-399887f91bf6 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.204955 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6568-b845-456e-9dda-399887f91bf6 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.205176 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6568-b845-456e-9dda-399887f91bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.225200 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-14dc6568-b845-456e-9dda-399887f91bf6 None None] MFA Rules not processed for user `51c432d2d2ec4be6b34839a86ce15036`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:48:01.226514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-14dc6568-b845-456e-9dda-399887f91bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:48:01.271882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:01.281795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 556/1121] 10.222.0.59 () {58 vars in 1061 bytes} [Mon Aug 22 17:48:01 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:48:01.290411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7041302-2c83-4b8a-9d0e-c6863e654f9b None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:01.306620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7041302-2c83-4b8a-9d0e-c6863e654f9b None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:01.310833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c432d2d2ec4be6b34839a86ce15036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:01.311773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.312044 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.312328 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.321834 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:01.324055 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:01.337901 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 566/1122] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:48:01 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:48:01.376067 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5dacf-3c27-4524-964d-24c8ac627f83 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.376346 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5dacf-3c27-4524-964d-24c8ac627f83 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.376644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5dacf-3c27-4524-964d-24c8ac627f83 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.377881 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 557/1123] 10.222.0.59 () {52 vars in 830 bytes} [Mon Aug 22 17:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:48:01.381850 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:01.445677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a1d76-d27c-489b-9cfa-e755ccb1a7a7 service cinder] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:01.450773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:01.451429 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.451703 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.451973 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] PATH_INFO: `/v3/users/4646d0785ca84e29b4faf2317b43ed79` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.453202 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4646d0785ca84e29b4faf2317b43ed79)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:01.454221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING py.warnings [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:01.454221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: warnings.warn(msg) Aug 22 17:48:01.454221 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: Aug 22 17:48:01.455431 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:01.540547 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4646d0785ca84e29b4faf2317b43ed79'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:01.541294 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4646d0785ca84e29b4faf2317b43ed79'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:01.558229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4646d0785ca84e29b4faf2317b43ed79'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:01.587952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4646d0785ca84e29b4faf2317b43ed79'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:01.602941 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4646d0785ca84e29b4faf2317b43ed79'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:01.611646 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 567/1124] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Aug 22 17:48:01 2022] DELETE /identity/v3/users/4646d0785ca84e29b4faf2317b43ed79 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:48:01.616329 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.616679 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.616974 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.636660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:48:01.637901 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:48:01.700369 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 558/1125] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:48:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:48:01.709965 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:01.711449 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:48:01.717198 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:01.775538 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0720b-81a9-4bc4-baed-0a0428078fa3 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:01.779881 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b07a9-2db1-44e3-b2b8-596bb1bc4453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:01.780495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b07a9-2db1-44e3-b2b8-596bb1bc4453 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:01.780811 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b07a9-2db1-44e3-b2b8-596bb1bc4453 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:01.781080 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b07a9-2db1-44e3-b2b8-596bb1bc4453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:01.792128 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b07a9-2db1-44e3-b2b8-596bb1bc4453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:01.794293 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b07a9-2db1-44e3-b2b8-596bb1bc4453 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:01.809045 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 568/1126] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:48:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:48:02.169240 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:48:02.171201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:48:02.187794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548262-4575-497b-80b8-6e712f5d0a3b None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:48:02.192916 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:48:02.193559 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:48:02.193835 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:48:02.194100 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] PATH_INFO: `/v3/projects/c7e20d6138e14f3ca8ffd918024d2475` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:48:02.195862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e20d6138e14f3ca8ffd918024d2475)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:48:02.196995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:48:02.196995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 17:48:02.196995 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 17:48:02.198232 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:48:02.262536 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e20d6138e14f3ca8ffd918024d2475', 'request_id': 'req-58f33290-ecf3-4909-adc2-45b8a48f5507'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:02.276949 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e20d6138e14f3ca8ffd918024d2475', 'request_id': 'req-58f33290-ecf3-4909-adc2-45b8a48f5507'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:02.289780 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e20d6138e14f3ca8ffd918024d2475', 'request_id': 'req-58f33290-ecf3-4909-adc2-45b8a48f5507'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:02.301452 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] The token cache is being invalidate because project c7e20d6138e14f3ca8ffd918024d2475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:48:02.301748 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:02.302493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-58f33290-ecf3-4909-adc2-45b8a48f5507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:48:02.304131 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 559/1127] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Aug 22 17:48:02 2022] DELETE /identity/v3/projects/c7e20d6138e14f3ca8ffd918024d2475 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:48:11.802701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=25 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:12.298336 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:30.914871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e8c5-41d9-463b-996e-e5d73307a96e None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:30.915712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e8c5-41d9-463b-996e-e5d73307a96e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:30.915712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e8c5-41d9-463b-996e-e5d73307a96e None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:30.916853 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 569/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:49:30.922920 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d221-bceb-4d28-8a95-7ad892546094 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:30.923699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d221-bceb-4d28-8a95-7ad892546094 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:30.923824 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d221-bceb-4d28-8a95-7ad892546094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:31.002150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-afe3d221-bceb-4d28-8a95-7ad892546094 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:31.003375 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-afe3d221-bceb-4d28-8a95-7ad892546094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:31.113776 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 560/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:49:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:31.276035 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13e8c5-41d9-463b-996e-e5d73307a96e None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:49:31.279415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4c13e8c5-41d9-463b-996e-e5d73307a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:31.378999 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13e8c5-41d9-463b-996e-e5d73307a96e None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:49:31.384556 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e08d-316c-41a9-9a42-0854e87f843f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:49:31.385292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e08d-316c-41a9-9a42-0854e87f843f service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:31.385565 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e08d-316c-41a9-9a42-0854e87f843f service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:31.385830 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e08d-316c-41a9-9a42-0854e87f843f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:31.394281 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e08d-316c-41a9-9a42-0854e87f843f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:49:31.395880 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e08d-316c-41a9-9a42-0854e87f843f service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:49:31.405427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 570/1130] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:49:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:49:32.241910 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f10b-9a43-4758-a9c7-ffe3e6ed24d7 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:32.242818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f10b-9a43-4758-a9c7-ffe3e6ed24d7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:32.242818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f10b-9a43-4758-a9c7-ffe3e6ed24d7 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:32.245045 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 561/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:49:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:49:32.251296 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683764f7-a919-4b2c-80ad-89b3cbc22ac2 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:32.251989 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683764f7-a919-4b2c-80ad-89b3cbc22ac2 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:32.252086 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683764f7-a919-4b2c-80ad-89b3cbc22ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:32.278083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-683764f7-a919-4b2c-80ad-89b3cbc22ac2 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:32.279304 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-683764f7-a919-4b2c-80ad-89b3cbc22ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:32.288381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 571/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:49:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:32.447729 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f10b-9a43-4758-a9c7-ffe3e6ed24d7 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:49:32.467898 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f10b-9a43-4758-a9c7-ffe3e6ed24d7 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:49:32.475292 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f8bfb-1813-4234-a73e-27357d8bc366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:49:32.476168 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8bfb-1813-4234-a73e-27357d8bc366 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:32.476513 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8bfb-1813-4234-a73e-27357d8bc366 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:32.476902 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8bfb-1813-4234-a73e-27357d8bc366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:32.490068 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f8bfb-1813-4234-a73e-27357d8bc366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:49:32.492546 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f8bfb-1813-4234-a73e-27357d8bc366 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:49:32.502962 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 562/1133] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:49:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:49:36.551333 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af3906-7762-4200-9196-8fa1a81f2808 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:36.551921 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af3906-7762-4200-9196-8fa1a81f2808 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:36.551921 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af3906-7762-4200-9196-8fa1a81f2808 None None] PATH_INFO: `/v3` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:36.553416 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 572/1134] 10.222.0.77 () {54 vars in 925 bytes} [Mon Aug 22 17:49:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:49:36.559975 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164f11-3ccd-4570-b4e2-969748dc6f61 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:36.560420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164f11-3ccd-4570-b4e2-969748dc6f61 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:36.560542 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164f11-3ccd-4570-b4e2-969748dc6f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:36.591858 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-61164f11-3ccd-4570-b4e2-969748dc6f61 None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:36.593175 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-61164f11-3ccd-4570-b4e2-969748dc6f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:36.648354 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:36.658833 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 563/1135] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 22 17:49:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:42.272188 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=42 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:43.747723 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144ba8-d148-44fb-b285-07a32eb4c7f8 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:43.748700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144ba8-d148-44fb-b285-07a32eb4c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:43.749028 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144ba8-d148-44fb-b285-07a32eb4c7f8 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:43.753087 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 573/1136] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:49:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:49:43.758830 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f556-f4c3-41ab-a941-f7e40744912b None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:43.759301 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f556-f4c3-41ab-a941-f7e40744912b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:43.759442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f556-f4c3-41ab-a941-f7e40744912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:43.783054 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-0d53f556-f4c3-41ab-a941-f7e40744912b None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:43.784275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-0d53f556-f4c3-41ab-a941-f7e40744912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:43.794047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 564/1137] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:49:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:43.955424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144ba8-d148-44fb-b285-07a32eb4c7f8 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:49:43.969638 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144ba8-d148-44fb-b285-07a32eb4c7f8 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:49:43.975048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ce349-923b-4e4e-8994-c0211aac9e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:49:43.975659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce349-923b-4e4e-8994-c0211aac9e93 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:43.975929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce349-923b-4e4e-8994-c0211aac9e93 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:43.976192 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce349-923b-4e4e-8994-c0211aac9e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:43.985077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ce349-923b-4e4e-8994-c0211aac9e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:49:43.986657 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ce349-923b-4e4e-8994-c0211aac9e93 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:49:43.998631 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 574/1138] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:49:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:49:44.827574 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3f19e-cb49-498d-a4d0-a345d8a46db6 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:44.828132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3f19e-cb49-498d-a4d0-a345d8a46db6 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:44.828132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3f19e-cb49-498d-a4d0-a345d8a46db6 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:44.829487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 565/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:49:44.834435 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07bc4-3cb1-44e6-8e0f-1d480ccee141 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:44.834858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07bc4-3cb1-44e6-8e0f-1d480ccee141 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:44.835003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07bc4-3cb1-44e6-8e0f-1d480ccee141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:44.857870 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-b5d07bc4-3cb1-44e6-8e0f-1d480ccee141 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:44.859078 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-b5d07bc4-3cb1-44e6-8e0f-1d480ccee141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:44.868212 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 575/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:49:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:45.027719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3f19e-cb49-498d-a4d0-a345d8a46db6 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:49:45.049769 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3f19e-cb49-498d-a4d0-a345d8a46db6 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:49:45.058204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec107892-33f3-4878-9ec7-ff0de75976c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:49:45.058801 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107892-33f3-4878-9ec7-ff0de75976c0 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:45.059077 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107892-33f3-4878-9ec7-ff0de75976c0 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:45.059344 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107892-33f3-4878-9ec7-ff0de75976c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:45.067566 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec107892-33f3-4878-9ec7-ff0de75976c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:49:45.069233 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec107892-33f3-4878-9ec7-ff0de75976c0 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:49:45.079228 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 566/1141] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:49:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:49:46.071483 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e0a2-32d7-40b5-98b9-a2bba6c80808 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:46.072304 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e0a2-32d7-40b5-98b9-a2bba6c80808 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:46.072304 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e0a2-32d7-40b5-98b9-a2bba6c80808 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:46.074479 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 576/1142] 10.222.0.59 () {54 vars in 961 bytes} [Mon Aug 22 17:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:49:46.080479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7018abe-65ef-4e52-a945-43a6be503639 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:46.081255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7018abe-65ef-4e52-a945-43a6be503639 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:46.081387 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7018abe-65ef-4e52-a945-43a6be503639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:46.104010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-c7018abe-65ef-4e52-a945-43a6be503639 None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:46.105242 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-c7018abe-65ef-4e52-a945-43a6be503639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:46.115121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 567/1143] 10.222.0.59 () {58 vars in 1058 bytes} [Mon Aug 22 17:49:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:46.190409 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72e0a2-32d7-40b5-98b9-a2bba6c80808 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:49:46.205397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72e0a2-32d7-40b5-98b9-a2bba6c80808 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:49:46.210531 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824288ba-ce84-4ac5-ac11-56aa997d5c6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd40f73d7b494ef1ba7e17bdb202ccee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:49:46.211139 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824288ba-ce84-4ac5-ac11-56aa997d5c6d service placement] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:46.211412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824288ba-ce84-4ac5-ac11-56aa997d5c6d service placement] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:46.211678 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824288ba-ce84-4ac5-ac11-56aa997d5c6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:46.220792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824288ba-ce84-4ac5-ac11-56aa997d5c6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:49:46.222381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824288ba-ce84-4ac5-ac11-56aa997d5c6d service placement] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:49:46.232232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 577/1144] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:49:46 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:49:56.098977 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=12 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:56.228700 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=15 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:56.325804 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ebd7-f56c-4560-8017-3c9052fb9e67 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:56.326084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ebd7-f56c-4560-8017-3c9052fb9e67 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:56.326352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ebd7-f56c-4560-8017-3c9052fb9e67 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:56.327730 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 568/1145] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:49:56.333769 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65309a3-c869-4def-bd51-56c31fa8bdf8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:56.334071 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65309a3-c869-4def-bd51-56c31fa8bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:56.334381 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65309a3-c869-4def-bd51-56c31fa8bdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:56.356240 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-f65309a3-c869-4def-bd51-56c31fa8bdf8 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:56.357404 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-f65309a3-c869-4def-bd51-56c31fa8bdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:56.366518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 578/1146] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:49:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:56.528637 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279ebd7-f56c-4560-8017-3c9052fb9e67 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:49:56.551263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279ebd7-f56c-4560-8017-3c9052fb9e67 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:49:56.558658 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f90a9-1c40-469d-bab0-2cc3751d0f42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:49:56.559258 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f90a9-1c40-469d-bab0-2cc3751d0f42 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:56.559534 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f90a9-1c40-469d-bab0-2cc3751d0f42 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:56.559834 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f90a9-1c40-469d-bab0-2cc3751d0f42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:56.568846 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f90a9-1c40-469d-bab0-2cc3751d0f42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:49:56.570446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f90a9-1c40-469d-bab0-2cc3751d0f42 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:49:56.580201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 569/1147] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:49:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:49:57.407358 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688030db-4268-4dde-8aae-33389903b991 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:57.408263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688030db-4268-4dde-8aae-33389903b991 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:57.408426 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688030db-4268-4dde-8aae-33389903b991 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:57.410693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 579/1148] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:49:57.416841 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b2f66-48f4-4134-92c5-284ed01e57d5 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:57.417545 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b2f66-48f4-4134-92c5-284ed01e57d5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:57.417655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b2f66-48f4-4134-92c5-284ed01e57d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:57.447514 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-619b2f66-48f4-4134-92c5-284ed01e57d5 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:49:57.448751 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-619b2f66-48f4-4134-92c5-284ed01e57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:49:57.457458 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 570/1149] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:49:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:49:57.619310 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688030db-4268-4dde-8aae-33389903b991 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:49:57.639746 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688030db-4268-4dde-8aae-33389903b991 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:49:57.646655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee3802-0dbc-4b26-8bc5-488c4bfdf978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:49:57.647244 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee3802-0dbc-4b26-8bc5-488c4bfdf978 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:49:57.647499 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee3802-0dbc-4b26-8bc5-488c4bfdf978 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:49:57.647756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee3802-0dbc-4b26-8bc5-488c4bfdf978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:49:57.656468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee3802-0dbc-4b26-8bc5-488c4bfdf978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:49:57.658099 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee3802-0dbc-4b26-8bc5-488c4bfdf978 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:49:57.667825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 580/1150] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:49:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:50:01.955229 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247c40-ec91-4622-9eb7-249e74172441 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:01.956104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247c40-ec91-4622-9eb7-249e74172441 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:01.956104 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247c40-ec91-4622-9eb7-249e74172441 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:01.958302 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 571/1151] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:50:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:50:01.967411 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebbfc-a4dd-4957-9afc-3e106aa08970 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:01.967868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebbfc-a4dd-4957-9afc-3e106aa08970 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:01.967964 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebbfc-a4dd-4957-9afc-3e106aa08970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:01.993118 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-9f2ebbfc-a4dd-4957-9afc-3e106aa08970 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:50:01.994460 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-9f2ebbfc-a4dd-4957-9afc-3e106aa08970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:50:02.003931 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 581/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:50:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:50:02.353365 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247c40-ec91-4622-9eb7-249e74172441 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:50:02.355373 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-42247c40-ec91-4622-9eb7-249e74172441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:50:02.418220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247c40-ec91-4622-9eb7-249e74172441 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:50:02.421935 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8c6b-4f9a-47c9-940d-0e71cb9562e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:50:02.422537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8c6b-4f9a-47c9-940d-0e71cb9562e2 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:02.422816 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8c6b-4f9a-47c9-940d-0e71cb9562e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:02.423083 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8c6b-4f9a-47c9-940d-0e71cb9562e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:02.432361 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8c6b-4f9a-47c9-940d-0e71cb9562e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:50:02.433838 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8c6b-4f9a-47c9-940d-0e71cb9562e2 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:50:02.442897 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 572/1153] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:50:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:50:04.596324 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41c34-6ac9-40e9-a987-9e0c9d0fa94b None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:04.597280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41c34-6ac9-40e9-a987-9e0c9d0fa94b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:04.597280 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41c34-6ac9-40e9-a987-9e0c9d0fa94b None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:04.599314 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 582/1154] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:50:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:50:04.608512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24a25e-6753-4db8-8d3f-b92c242eae2a None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:04.608954 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24a25e-6753-4db8-8d3f-b92c242eae2a None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:04.609145 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24a25e-6753-4db8-8d3f-b92c242eae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:04.634066 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-2a24a25e-6753-4db8-8d3f-b92c242eae2a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:50:04.635271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-2a24a25e-6753-4db8-8d3f-b92c242eae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:50:04.643150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 573/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:50:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:50:04.981550 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41c34-6ac9-40e9-a987-9e0c9d0fa94b None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:50:04.994517 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41c34-6ac9-40e9-a987-9e0c9d0fa94b None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:50:04.998326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39fe09-fd94-4f00-b286-51ba4a34562a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:50:04.998924 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fe09-fd94-4f00-b286-51ba4a34562a service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:04.999191 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fe09-fd94-4f00-b286-51ba4a34562a service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:04.999458 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fe09-fd94-4f00-b286-51ba4a34562a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:05.008495 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39fe09-fd94-4f00-b286-51ba4a34562a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:50:05.009863 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39fe09-fd94-4f00-b286-51ba4a34562a service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:50:05.019134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 583/1156] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:50:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:50:08.765922 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcb99e-bd49-42ef-abb7-7793baa35c53 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:08.766552 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcb99e-bd49-42ef-abb7-7793baa35c53 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:08.766552 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcb99e-bd49-42ef-abb7-7793baa35c53 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:08.768412 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 574/1157] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:50:08.773845 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d97ed-52f7-473d-a652-efc7d3411c2a None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:08.774317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d97ed-52f7-473d-a652-efc7d3411c2a None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:08.774419 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d97ed-52f7-473d-a652-efc7d3411c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:08.795093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-691d97ed-52f7-473d-a652-efc7d3411c2a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:50:08.796275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-691d97ed-52f7-473d-a652-efc7d3411c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:50:08.804754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 584/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:50:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:50:09.367132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcb99e-bd49-42ef-abb7-7793baa35c53 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:50:09.370044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-6efcb99e-bd49-42ef-abb7-7793baa35c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:50:09.447352 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcb99e-bd49-42ef-abb7-7793baa35c53 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:50:09.451854 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860f6f0-d932-4dfe-8458-f18988fb1720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c432d2d2ec4be6b34839a86ce15036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:50:09.452451 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f6f0-d932-4dfe-8458-f18988fb1720 service cinder] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:09.452767 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f6f0-d932-4dfe-8458-f18988fb1720 service cinder] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:09.453025 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f6f0-d932-4dfe-8458-f18988fb1720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:09.462716 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860f6f0-d932-4dfe-8458-f18988fb1720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:50:09.464149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860f6f0-d932-4dfe-8458-f18988fb1720 service cinder] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:50:09.473647 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 575/1159] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:50:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:50:11.644088 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaffd8-2512-43fa-98d3-aac607e0d11f None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:11.644745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaffd8-2512-43fa-98d3-aac607e0d11f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:11.644745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaffd8-2512-43fa-98d3-aac607e0d11f None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:11.646020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 585/1160] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:50:11.651572 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9286-f62a-4117-971d-4f319597df6a None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:11.652044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9286-f62a-4117-971d-4f319597df6a None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:11.652149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9286-f62a-4117-971d-4f319597df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:11.672930 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-f2da9286-f62a-4117-971d-4f319597df6a None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:50:11.674105 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-f2da9286-f62a-4117-971d-4f319597df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:50:11.682801 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 576/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:50:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:50:12.243692 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaffd8-2512-43fa-98d3-aac607e0d11f None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:50:12.245772 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-deaaffd8-2512-43fa-98d3-aac607e0d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:50:12.261842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaffd8-2512-43fa-98d3-aac607e0d11f None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:50:12.266602 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff618b-3b71-4c0c-b61d-405d2dc2d926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c432d2d2ec4be6b34839a86ce15036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:50:12.266788 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff618b-3b71-4c0c-b61d-405d2dc2d926 service cinder] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:50:12.267068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff618b-3b71-4c0c-b61d-405d2dc2d926 service cinder] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:50:12.267335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff618b-3b71-4c0c-b61d-405d2dc2d926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:50:12.279734 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff618b-3b71-4c0c-b61d-405d2dc2d926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:50:12.282531 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff618b-3b71-4c0c-b61d-405d2dc2d926 service cinder] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:50:12.293593 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 586/1162] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:50:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:50:21.668280 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=72 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:22.289087 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=27 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:28.412528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfa56b-e3a6-41be-a264-de8104b242bb None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.413201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfa56b-e3a6-41be-a264-de8104b242bb None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.413201 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfa56b-e3a6-41be-a264-de8104b242bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.424279 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8c99-65e5-4d61-bb5c-a5db3880e6f7 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.424878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8c99-65e5-4d61-bb5c-a5db3880e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.424878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8c99-65e5-4d61-bb5c-a5db3880e6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.433665 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-61cfa56b-e3a6-41be-a264-de8104b242bb None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:28.434851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-61cfa56b-e3a6-41be-a264-de8104b242bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:28.443437 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 577/1163] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:28.445339 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-3aed8c99-65e5-4d61-bb5c-a5db3880e6f7 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:28.446516 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-3aed8c99-65e5-4d61-bb5c-a5db3880e6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:28.451868 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9613d3-1b8f-431b-a2f6-59659fb236a9 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.452150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9613d3-1b8f-431b-a2f6-59659fb236a9 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.452700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9613d3-1b8f-431b-a2f6-59659fb236a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.454543 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 587/1164] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:51:28.462602 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a83d-ee18-4ea6-bcdb-883d32b4cd53 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.462854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a83d-ee18-4ea6-bcdb-883d32b4cd53 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.463153 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a83d-ee18-4ea6-bcdb-883d32b4cd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.472526 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-ba9613d3-1b8f-431b-a2f6-59659fb236a9 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:28.473810 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-ba9613d3-1b8f-431b-a2f6-59659fb236a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:28.481684 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 578/1165] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:51:28.482337 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-2995a83d-ee18-4ea6-bcdb-883d32b4cd53 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:28.483516 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-2995a83d-ee18-4ea6-bcdb-883d32b4cd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:28.486323 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9613d3-1b8f-431b-a2f6-59659fb236a9 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.491474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 588/1166] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:51:28.495715 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9613d3-1b8f-431b-a2f6-59659fb236a9 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.495876 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995a83d-ee18-4ea6-bcdb-883d32b4cd53 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.500198 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.500808 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.501081 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.501350 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.501979 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:51:28.502272 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.503908 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.505234 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995a83d-ee18-4ea6-bcdb-883d32b4cd53 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.511031 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.511654 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.511937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.512206 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] PATH_INFO: `/v3/domains` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.513345 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=100233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:51:28.513817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.514831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING py.warnings [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:51:28.514831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: warnings.warn(msg) Aug 22 17:51:28.514831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: Aug 22 17:51:28.515717 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 579/1167] 10.222.0.59 () {58 vars in 1153 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:51:28.515834 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.523678 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.528072 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 589/1168] 10.222.0.59 () {58 vars in 1153 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:51:28.533531 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5979cb-a3ec-4925-b3a3-da168c452a80 admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.535805 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.538777 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.539384 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.539660 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.539920 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.540534 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.541627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:51:28.541627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 17:51:28.541627 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 17:51:28.542839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.545395 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c0a4c-d6e7-4b3e-9806-f62c1e3aee52 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.549925 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.550608 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.551047 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.551313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.552826 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.554701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.581528 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 580/1169] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:51:28.585911 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.586748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 590/1170] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:51:28.590870 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.650912 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b3e9-3be8-487c-aa9f-bfb31dbec21a admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.653333 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fae49-05ff-491c-967f-bfee8428e2f8 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.656243 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.656890 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.657161 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.657430 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.658042 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.658152 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.658740 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.659006 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.659288 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.659952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.660108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.660994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING py.warnings [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:51:28.660994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: warnings.warn(msg) Aug 22 17:51:28.660994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: Aug 22 17:51:28.662210 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.683967 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 581/1171] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:51:28.685054 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 591/1172] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:51:28.690030 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.691079 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.700367 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c913e-421c-41ee-9d28-936a7bd99278 admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.701305 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79941365-2d55-4012-be37-7da8ab66e6be admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.705047 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.705640 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.705938 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.706208 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.706909 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.707096 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.707503 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.707778 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.708040 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.708705 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.708863 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.710336 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.721915 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 582/1173] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:51:28.722100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 592/1174] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:51:28.724639 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.724774 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.734187 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b77e0-99de-4486-b17d-9bfc35f5b68b admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.734355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c813861-f845-42a4-9b28-65254f5e34b2 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.738874 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.739467 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.739613 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.739746 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.740019 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.740169 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.740439 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.740689 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.740786 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.741341 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.742283 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.742886 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.752722 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 583/1175] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:51:28.753168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 593/1176] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:51:28.756944 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.757217 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.766607 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f2850-7167-4d2f-b2df-c52eac451c1c admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.766779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6732fa6-17ce-4f25-a5eb-77b06b3a49b7 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.771369 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603733c-dc1b-4072-8dbb-b00863e8a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.771533 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8acb85-943f-4ba1-9774-f8e0b0e41e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.772034 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603733c-dc1b-4072-8dbb-b00863e8a876 admin admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.772173 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8acb85-943f-4ba1-9774-f8e0b0e41e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.772306 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603733c-dc1b-4072-8dbb-b00863e8a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.772486 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8acb85-943f-4ba1-9774-f8e0b0e41e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.772604 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603733c-dc1b-4072-8dbb-b00863e8a876 admin admin] PATH_INFO: `/v3/projects/c02ba3273e5a4a50a780781ec2dd0066/users/fc67644b403243cb9fd489d1e01fd402/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.772741 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8acb85-943f-4ba1-9774-f8e0b0e41e81 admin admin] PATH_INFO: `/v3/projects/9f2d1cfeaa0f4c27b102b3b6478212d0/users/07ba1cf9e543423b85474abf85b406a3/roles/503842e4c2704f92b9ed69eb792b3c8c` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.787731 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8acb85-943f-4ba1-9774-f8e0b0e41e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d1cfeaa0f4c27b102b3b6478212d0, user_id=07ba1cf9e543423b85474abf85b406a3, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.788029 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603733c-dc1b-4072-8dbb-b00863e8a876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02ba3273e5a4a50a780781ec2dd0066, user_id=fc67644b403243cb9fd489d1e01fd402, role_id=503842e4c2704f92b9ed69eb792b3c8c)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:28.788705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-ba8acb85-943f-4ba1-9774-f8e0b0e41e81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:51:28.788705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 17:51:28.788705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 17:51:28.790643 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8acb85-943f-4ba1-9774-f8e0b0e41e81 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.790764 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603733c-dc1b-4072-8dbb-b00863e8a876 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:28.807309 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 584/1177] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Aug 22 17:51:28 2022] PUT /identity/v3/projects/9f2d1cfeaa0f4c27b102b3b6478212d0/users/07ba1cf9e543423b85474abf85b406a3/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:51:28.811036 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 594/1178] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Aug 22 17:51:28 2022] PUT /identity/v3/projects/c02ba3273e5a4a50a780781ec2dd0066/users/fc67644b403243cb9fd489d1e01fd402/roles/503842e4c2704f92b9ed69eb792b3c8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:51:28.812375 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.812760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.813121 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.814110 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe30d-7d42-49ab-a3ed-b2222553b9f2 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.814397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe30d-7d42-49ab-a3ed-b2222553b9f2 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.814667 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe30d-7d42-49ab-a3ed-b2222553b9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:28.832264 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:28.833400 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-f95fe30d-7d42-49ab-a3ed-b2222553b9f2 None None] MFA Rules not processed for user `b314b21b589848739470473da31c8430`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:28.833567 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:28.834585 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-f95fe30d-7d42-49ab-a3ed-b2222553b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:28.878099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:28.887474 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:28.902794 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 585/1179] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:28.903825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 595/1180] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:28.914273 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.915905 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe30d-7d42-49ab-a3ed-b2222553b9f2 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:28.916139 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:28.981697 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe30d-7d42-49ab-a3ed-b2222553b9f2 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:28.987560 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeeca1-7813-4fe4-82e3-b0858f7d6544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:28.988232 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeca1-7813-4fe4-82e3-b0858f7d6544 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:28.988597 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeca1-7813-4fe4-82e3-b0858f7d6544 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:28.988916 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeca1-7813-4fe4-82e3-b0858f7d6544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:29.001370 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeeca1-7813-4fe4-82e3-b0858f7d6544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:29.002163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea1126-ff20-4464-9b38-6f4c97656a21 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:29.002825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeeca1-7813-4fe4-82e3-b0858f7d6544 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:29.009398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:29.012242 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:29.012716 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:29.013150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:29.015681 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 596/1181] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:51:29.025614 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:29.027127 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:29.048696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 586/1182] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:51:33.967360 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bad1-9589-42fa-9065-ae1b21dc1535 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:33.967902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bad1-9589-42fa-9065-ae1b21dc1535 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:33.967902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bad1-9589-42fa-9065-ae1b21dc1535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.019950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-7d61bad1-9589-42fa-9065-ae1b21dc1535 None None] MFA Rules not processed for user `07ba1cf9e543423b85474abf85b406a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:34.021679 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-7d61bad1-9589-42fa-9065-ae1b21dc1535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:34.126584 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 597/1183] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:33 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:34.131255 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.175453 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fba11e-2cff-457f-918f-6b3ae0595d55 service neutron] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.195480 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832387-70f5-4bff-89f2-0238a1ae4dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.196443 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832387-70f5-4bff-89f2-0238a1ae4dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.196897 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832387-70f5-4bff-89f2-0238a1ae4dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.197326 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832387-70f5-4bff-89f2-0238a1ae4dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.198111 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832387-70f5-4bff-89f2-0238a1ae4dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.200442 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832387-70f5-4bff-89f2-0238a1ae4dd4 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:34.260994 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 587/1184] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Aug 22 17:51:34 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:51:34.268353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61bad1-9589-42fa-9065-ae1b21dc1535 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.285185 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61bad1-9589-42fa-9065-ae1b21dc1535 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.408083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.408830 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.410696 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.411082 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] PATH_INFO: `/v3/users` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.412143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.420962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:34.446487 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73440-50d6-4b8d-a8cf-ffde17114b5b None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.447619 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73440-50d6-4b8d-a8cf-ffde17114b5b None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.448502 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73440-50d6-4b8d-a8cf-ffde17114b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.467195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 598/1185] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:51:34 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:51:34.471237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.482371 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-c1d73440-50d6-4b8d-a8cf-ffde17114b5b None None] MFA Rules not processed for user `fc67644b403243cb9fd489d1e01fd402`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:34.483827 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-c1d73440-50d6-4b8d-a8cf-ffde17114b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:34.485910 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b3d3-a4b3-4eec-95b4-756d4cd78312 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.492042 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.492962 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.493331 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.493629 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.495109 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.496591 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:34.513833 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 599/1186] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:51:34.516100 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.528051 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb21a-0302-499f-ae52-6fe6c3db8665 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.533038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.533713 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.533986 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.534350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] PATH_INFO: `/v3/projects/4980c13955564febaebe4e1985cc9b23/users/34a37335fab04d53998fd5d40d2f4fb2/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.537215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:34.553124 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4980c13955564febaebe4e1985cc9b23, user_id=34a37335fab04d53998fd5d40d2f4fb2, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.555903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:34.563293 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 588/1187] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:34 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:51:34.570483 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d73440-50d6-4b8d-a8cf-ffde17114b5b None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.580142 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 600/1188] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Aug 22 17:51:34 2022] PUT /identity/v3/projects/4980c13955564febaebe4e1985cc9b23/users/34a37335fab04d53998fd5d40d2f4fb2/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:51:34.581334 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.584939 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d73440-50d6-4b8d-a8cf-ffde17114b5b None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.650969 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:34.662051 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449b05d-a7b8-4bd0-bd0c-542e84e467e3 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.670545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.671378 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.671807 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.672086 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.672773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.674656 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:34.676162 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.677228 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.677510 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.677787 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] PATH_INFO: `/v3/projects` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.678482 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.680476 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:34.691044 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 601/1189] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:51:34.692335 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.703044 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92726-8faf-40d0-9b9a-71b9e4ed3ed6 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.708875 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.709636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] REQUEST_METHOD: `PUT` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.709912 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.710193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] PATH_INFO: `/v3/projects/4980c13955564febaebe4e1985cc9b23/users/34a37335fab04d53998fd5d40d2f4fb2/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.712991 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4980c13955564febaebe4e1985cc9b23, user_id=34a37335fab04d53998fd5d40d2f4fb2, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.716635 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:34.723460 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 589/1190] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Aug 22 17:51:34 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:51:34.725479 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:34.732659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 602/1191] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Aug 22 17:51:34 2022] PUT /identity/v3/projects/4980c13955564febaebe4e1985cc9b23/users/34a37335fab04d53998fd5d40d2f4fb2/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:51:34.822682 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73227973-21d7-4457-b203-a4ee13f05680 admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:34.956744 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:34.957381 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:34.957655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:34.957981 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] PATH_INFO: `/v3/users` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:34.958705 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:34.969363 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:35.020107 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 590/1192] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Aug 22 17:51:34 2022] POST /identity/v3/users => generated 298 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:51:35.024026 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:35.041253 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16420b25-3a1f-4fec-9009-8892a74c5612 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:35.047141 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:35.047892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:35.048468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:35.048845 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:35.049620 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:35.052143 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:35.067693 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 603/1193] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:51:35.071839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:35.084142 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a744ed-5554-4359-8d5a-d63b683121a5 admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:35.092163 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:35.092978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:35.093154 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:35.093446 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] PATH_INFO: `/v3/projects/d086ea42bb18430e9cf6fded08b5c14f/users/26fa70b8e4034f778ca2a89b2d779bd2/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:35.129925 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d086ea42bb18430e9cf6fded08b5c14f, user_id=26fa70b8e4034f778ca2a89b2d779bd2, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:35.132896 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:35.167860 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 591/1194] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Aug 22 17:51:35 2022] PUT /identity/v3/projects/d086ea42bb18430e9cf6fded08b5c14f/users/26fa70b8e4034f778ca2a89b2d779bd2/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:51:35.171759 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:35.185914 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222d5d3-0938-406b-85df-8acd67f0ecf5 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:35.353563 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df4be-2069-466a-8e9c-1ee9c3581320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:35.354457 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df4be-2069-466a-8e9c-1ee9c3581320 admin admin] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:35.354731 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df4be-2069-466a-8e9c-1ee9c3581320 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:35.354994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df4be-2069-466a-8e9c-1ee9c3581320 admin admin] PATH_INFO: `/v3/roles` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:35.355642 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df4be-2069-466a-8e9c-1ee9c3581320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:35.357600 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df4be-2069-466a-8e9c-1ee9c3581320 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:35.370628 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 604/1195] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Aug 22 17:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:51:35.375462 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:35.388296 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0df80-bf41-4796-8b43-f86285848980 admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:35.395983 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:35.396802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] REQUEST_METHOD: `PUT` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:35.397147 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:35.398099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] PATH_INFO: `/v3/projects/d086ea42bb18430e9cf6fded08b5c14f/users/26fa70b8e4034f778ca2a89b2d779bd2/roles/1122faa21ccf460d936f2efb595661ff` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:35.400120 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d086ea42bb18430e9cf6fded08b5c14f, user_id=26fa70b8e4034f778ca2a89b2d779bd2, role_id=1122faa21ccf460d936f2efb595661ff)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:35.402715 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:35.418271 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 592/1196] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Aug 22 17:51:35 2022] PUT /identity/v3/projects/d086ea42bb18430e9cf6fded08b5c14f/users/26fa70b8e4034f778ca2a89b2d779bd2/roles/1122faa21ccf460d936f2efb595661ff => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:51:41.019859 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b252-441b-450a-b9a3-ea8685b7469f None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:41.020462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b252-441b-450a-b9a3-ea8685b7469f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:41.020462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b252-441b-450a-b9a3-ea8685b7469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:41.056365 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-cb40b252-441b-450a-b9a3-ea8685b7469f None None] MFA Rules not processed for user `34a37335fab04d53998fd5d40d2f4fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:41.058287 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-cb40b252-441b-450a-b9a3-ea8685b7469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:41.116003 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:41.152118 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 605/1197] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:41 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:41.175321 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:41.178423 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:41.230699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:41.298591 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc2c1b-6ebc-4854-af21-393f41dd849e admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:41.305420 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b91ae7fe5246bb9bb838bc5a4cc099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:41.306205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:41.306600 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:41.307116 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:41.352714 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b45c97-cfe4-42c1-b726-40701416069d None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:41.353203 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b45c97-cfe4-42c1-b726-40701416069d None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:41.353653 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b45c97-cfe4-42c1-b726-40701416069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:41.387420 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-e0b45c97-cfe4-42c1-b726-40701416069d None None] MFA Rules not processed for user `26fa70b8e4034f778ca2a89b2d779bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:41.388718 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-e0b45c97-cfe4-42c1-b726-40701416069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:41.392826 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:41.395084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:41.408132 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 593/1198] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:41 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:51:41.488788 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 606/1199] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:41 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:51:41.498440 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:41.512778 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56622066-aefc-4bda-a08e-1d1cb4834adb service glance] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:41.517512 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ec3ed-2006-4449-a9cd-d09590d5bf5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b91ae7fe5246bb9bb838bc5a4cc099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:41.518137 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec3ed-2006-4449-a9cd-d09590d5bf5f service glance] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:41.518416 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec3ed-2006-4449-a9cd-d09590d5bf5f service glance] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:41.519159 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec3ed-2006-4449-a9cd-d09590d5bf5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:41.635473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ec3ed-2006-4449-a9cd-d09590d5bf5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:41.637239 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ec3ed-2006-4449-a9cd-d09590d5bf5f service glance] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:41.654667 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 594/1200] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:41 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:51:50.053711 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e1b4-791b-459c-a6cf-8f34c720ce13 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.054316 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e1b4-791b-459c-a6cf-8f34c720ce13 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.054316 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e1b4-791b-459c-a6cf-8f34c720ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.073522 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-9dd8e1b4-791b-459c-a6cf-8f34c720ce13 None None] MFA Rules not processed for user `fc67644b403243cb9fd489d1e01fd402`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:50.074801 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-9dd8e1b4-791b-459c-a6cf-8f34c720ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:50.082317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 607/1201] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:51:50 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:50.375811 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9733b88-c626-4dba-b34d-39e27f9896df None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.377078 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9733b88-c626-4dba-b34d-39e27f9896df None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.377909 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9733b88-c626-4dba-b34d-39e27f9896df None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.379839 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 595/1202] 10.222.0.59 () {54 vars in 962 bytes} [Mon Aug 22 17:51:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:51:50.385239 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14871b16-755d-41fa-96d7-2f75e217f555 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.385559 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14871b16-755d-41fa-96d7-2f75e217f555 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.385869 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14871b16-755d-41fa-96d7-2f75e217f555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.419045 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-14871b16-755d-41fa-96d7-2f75e217f555 None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:50.420184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-14871b16-755d-41fa-96d7-2f75e217f555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:50.485703 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 608/1203] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Aug 22 17:51:50 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:50.491489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5507e-fa67-4180-b83e-46ce090ab726 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.491772 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5507e-fa67-4180-b83e-46ce090ab726 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.492044 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5507e-fa67-4180-b83e-46ce090ab726 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.493683 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 596/1204] 10.222.0.59 () {54 vars in 912 bytes} [Mon Aug 22 17:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:51:50.498736 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c050a-eb50-4623-a508-45273fa766fc None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.499020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c050a-eb50-4623-a508-45273fa766fc None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.499292 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c050a-eb50-4623-a508-45273fa766fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.520729 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-1c2c050a-eb50-4623-a508-45273fa766fc None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:50.521945 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-1c2c050a-eb50-4623-a508-45273fa766fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:50.533430 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 609/1205] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Aug 22 17:51:50 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:50.548388 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5507e-fa67-4180-b83e-46ce090ab726 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:50.551486 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-b6c5507e-fa67-4180-b83e-46ce090ab726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:50.564944 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5507e-fa67-4180-b83e-46ce090ab726 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:50.569136 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd438-6d09-4b61-b26a-09d7349a211f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0b91ae7fe5246bb9bb838bc5a4cc099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:50.570122 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd438-6d09-4b61-b26a-09d7349a211f service glance] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.570394 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd438-6d09-4b61-b26a-09d7349a211f service glance] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.572060 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd438-6d09-4b61-b26a-09d7349a211f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.582011 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd438-6d09-4b61-b26a-09d7349a211f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:50.583488 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd438-6d09-4b61-b26a-09d7349a211f service glance] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:50.595204 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 597/1206] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:51:50.945382 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e414c-0349-4087-be9e-e2a43f293b27 None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.945663 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e414c-0349-4087-be9e-e2a43f293b27 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.945935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e414c-0349-4087-be9e-e2a43f293b27 None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.947437 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 610/1207] 10.222.0.59 () {54 vars in 912 bytes} [Mon Aug 22 17:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:51:50.952374 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de4d03-02ee-4e58-ac6b-ce23276e58c3 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:50.952653 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de4d03-02ee-4e58-ac6b-ce23276e58c3 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:50.952958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de4d03-02ee-4e58-ac6b-ce23276e58c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:50.975252 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-46de4d03-02ee-4e58-ac6b-ce23276e58c3 None None] MFA Rules not processed for user `17d25b471b4a4c78bea1456094b584c4`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:50.976493 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-46de4d03-02ee-4e58-ac6b-ce23276e58c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:51.037146 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 598/1208] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Aug 22 17:51:50 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:51.048985 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e414c-0349-4087-be9e-e2a43f293b27 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:51.067038 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e414c-0349-4087-be9e-e2a43f293b27 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:51.070871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781edc-d6b5-4695-beff-4644da7063e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:51.071488 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781edc-d6b5-4695-beff-4644da7063e1 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.071769 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781edc-d6b5-4695-beff-4644da7063e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.072037 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781edc-d6b5-4695-beff-4644da7063e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.081676 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781edc-d6b5-4695-beff-4644da7063e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:51.083150 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781edc-d6b5-4695-beff-4644da7063e1 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:51.092448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 611/1209] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:51 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:51:51.502719 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426f354-fca8-4385-9a79-749141a035f4 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.503969 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426f354-fca8-4385-9a79-749141a035f4 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.503969 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426f354-fca8-4385-9a79-749141a035f4 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.505032 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 599/1210] 10.222.0.59 () {54 vars in 962 bytes} [Mon Aug 22 17:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:51:51.510686 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a6e3c-16eb-494f-a1e6-0c143adab9ad None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.511379 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a6e3c-16eb-494f-a1e6-0c143adab9ad None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.511892 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a6e3c-16eb-494f-a1e6-0c143adab9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.531220 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc457-7f0c-4124-92f8-53f222ba7d9c None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.531499 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc457-7f0c-4124-92f8-53f222ba7d9c None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.531793 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc457-7f0c-4124-92f8-53f222ba7d9c None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.533191 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 600/1211] 10.222.0.59 () {54 vars in 961 bytes} [Mon Aug 22 17:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:51:51.539112 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312596c8-2ce0-4847-b243-3ff085ac4522 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.539390 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312596c8-2ce0-4847-b243-3ff085ac4522 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.539662 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312596c8-2ce0-4847-b243-3ff085ac4522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.543787 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-154a6e3c-16eb-494f-a1e6-0c143adab9ad None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:51.545033 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-154a6e3c-16eb-494f-a1e6-0c143adab9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:51.555802 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 612/1212] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Aug 22 17:51:51 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:51.560867 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-312596c8-2ce0-4847-b243-3ff085ac4522 None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:51.561068 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec49fd-b396-414f-bb5d-b7b6efe2636f None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.561353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec49fd-b396-414f-bb5d-b7b6efe2636f None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.561625 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec49fd-b396-414f-bb5d-b7b6efe2636f None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.562641 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-312596c8-2ce0-4847-b243-3ff085ac4522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:51.562878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 613/1213] 10.222.0.59 () {54 vars in 912 bytes} [Mon Aug 22 17:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 17:51:51.567688 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa614a1e-181d-40a8-802b-8b92fc672b30 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.567952 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=100 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:51.568091 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa614a1e-181d-40a8-802b-8b92fc672b30 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.568230 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa614a1e-181d-40a8-802b-8b92fc672b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.591106 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-aa614a1e-181d-40a8-802b-8b92fc672b30 None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:51:51.592725 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-aa614a1e-181d-40a8-802b-8b92fc672b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:51.606237 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 614/1214] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Aug 22 17:51:51 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:51:51.618020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa614a1e-181d-40a8-802b-8b92fc672b30 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:51.628060 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa614a1e-181d-40a8-802b-8b92fc672b30 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:51.632123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41586fd9-a114-40d9-963a-aad7091bd83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:51.632775 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41586fd9-a114-40d9-963a-aad7091bd83a service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.633048 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41586fd9-a114-40d9-963a-aad7091bd83a service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.633316 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41586fd9-a114-40d9-963a-aad7091bd83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.639722 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=100 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:51.643813 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 601/1215] 10.222.0.59 () {58 vars in 1058 bytes} [Mon Aug 22 17:51:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:51:51.644765 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312596c8-2ce0-4847-b243-3ff085ac4522 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:51:51.644904 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41586fd9-a114-40d9-963a-aad7091bd83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:51.646375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41586fd9-a114-40d9-963a-aad7091bd83a service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:51.654575 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312596c8-2ce0-4847-b243-3ff085ac4522 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:51:51.657265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 615/1216] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:51 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:51:51.660513 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd40f73d7b494ef1ba7e17bdb202ccee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:51:51.661338 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:51:51.661614 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:51:51.661881 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:51:51.663616 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:51:51.677517 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:51:51.679095 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:51:51.689397 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 602/1217] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:51:51 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:52:01.652649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:01.685268 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=31 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:04.138687 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebde4f-25b9-4e82-a573-b4968f9f51b8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:04.139268 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebde4f-25b9-4e82-a573-b4968f9f51b8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:04.139268 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebde4f-25b9-4e82-a573-b4968f9f51b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:04.159609 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-ecebde4f-25b9-4e82-a573-b4968f9f51b8 None None] MFA Rules not processed for user `17d25b471b4a4c78bea1456094b584c4`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:52:04.160782 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-ecebde4f-25b9-4e82-a573-b4968f9f51b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:52:04.168481 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 616/1218] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 22 17:52:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:52:04.181691 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:52:04.192287 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d6b29-6841-46e2-83e8-08254401a37b service placement] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:52:04.197128 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a0e22-db8c-406b-8d33-481598a6a627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:52:04.197868 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a0e22-db8c-406b-8d33-481598a6a627 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:04.198150 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a0e22-db8c-406b-8d33-481598a6a627 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:04.198418 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a0e22-db8c-406b-8d33-481598a6a627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:04.206882 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a0e22-db8c-406b-8d33-481598a6a627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:52:04.208359 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a0e22-db8c-406b-8d33-481598a6a627 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:52:04.217875 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 603/1219] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:52:04 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:52:04.917854 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc6cf-5290-4d60-a16f-f84f60b75daa None None] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:04.918135 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc6cf-5290-4d60-a16f-f84f60b75daa None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:04.918433 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc6cf-5290-4d60-a16f-f84f60b75daa None None] PATH_INFO: `/` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:04.919921 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 617/1220] 10.222.0.59 () {54 vars in 921 bytes} [Mon Aug 22 17:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:52:04.928731 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3d9a-c1f2-4a6c-948b-2dcc9fccf104 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:04.929031 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3d9a-c1f2-4a6c-948b-2dcc9fccf104 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:04.929288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3d9a-c1f2-4a6c-948b-2dcc9fccf104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:04.957630 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-e7ff3d9a-c1f2-4a6c-948b-2dcc9fccf104 None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:52:04.958847 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-e7ff3d9a-c1f2-4a6c-948b-2dcc9fccf104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:52:04.968325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 604/1221] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Aug 22 17:52:04 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:52:04.981256 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cc6cf-5290-4d60-a16f-f84f60b75daa None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:52:04.995454 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cc6cf-5290-4d60-a16f-f84f60b75daa None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:52:05.000515 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6b602-1620-4572-9f4a-a13ecc875d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:52:05.001147 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b602-1620-4572-9f4a-a13ecc875d71 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:05.001427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b602-1620-4572-9f4a-a13ecc875d71 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:05.001748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b602-1620-4572-9f4a-a13ecc875d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:05.010928 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6b602-1620-4572-9f4a-a13ecc875d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:52:05.012842 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6b602-1620-4572-9f4a-a13ecc875d71 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:52:05.023903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 618/1222] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:52:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:52:13.114254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946276-918b-4b77-8f6a-6ee5324fc635 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:13.114254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946276-918b-4b77-8f6a-6ee5324fc635 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:13.114254 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946276-918b-4b77-8f6a-6ee5324fc635 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:13.115802 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 605/1223] 10.222.0.59 () {54 vars in 921 bytes} [Mon Aug 22 17:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:52:13.126469 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22681-c2d9-4337-8ce6-08f295862fa8 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:13.127137 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22681-c2d9-4337-8ce6-08f295862fa8 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:13.127137 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22681-c2d9-4337-8ce6-08f295862fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:13.150184 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-24a22681-c2d9-4337-8ce6-08f295862fa8 None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:52:13.151323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-24a22681-c2d9-4337-8ce6-08f295862fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:52:13.161946 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 619/1224] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Aug 22 17:52:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:52:13.176707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946276-918b-4b77-8f6a-6ee5324fc635 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:52:13.193239 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946276-918b-4b77-8f6a-6ee5324fc635 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:52:13.198376 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6fc3b-e1a4-442d-946d-518dd45d88d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:52:13.199473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6fc3b-e1a4-442d-946d-518dd45d88d0 service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:13.199473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6fc3b-e1a4-442d-946d-518dd45d88d0 service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:13.199473 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6fc3b-e1a4-442d-946d-518dd45d88d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:13.208934 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6fc3b-e1a4-442d-946d-518dd45d88d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:52:13.210523 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6fc3b-e1a4-442d-946d-518dd45d88d0 service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:52:13.220263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 606/1225] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:52:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:52:23.144777 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=12 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:23.216693 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=15 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:26.809910 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22681-c2d9-4337-8ce6-08f295862fa8 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:52:26.819659 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22681-c2d9-4337-8ce6-08f295862fa8 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:52:26.823346 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f038e-4817-4cb3-b8fe-218f7f4d9ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:52:26.823937 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f038e-4817-4cb3-b8fe-218f7f4d9ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:26.824208 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f038e-4817-4cb3-b8fe-218f7f4d9ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:26.824469 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f038e-4817-4cb3-b8fe-218f7f4d9ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:26.833879 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f038e-4817-4cb3-b8fe-218f7f4d9ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:52:26.835312 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f038e-4817-4cb3-b8fe-218f7f4d9ac2 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:52:26.845035 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 620/1226] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:52:26 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:52:28.830978 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd0d4e-d0fa-4d68-bd06-958a35406dc1 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:28.831895 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd0d4e-d0fa-4d68-bd06-958a35406dc1 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:28.832164 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd0d4e-d0fa-4d68-bd06-958a35406dc1 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:28.833551 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 607/1227] 10.222.0.59 () {54 vars in 921 bytes} [Mon Aug 22 17:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 17:52:28.839368 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b022-efef-4521-8fcb-04bbfd93c86e None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:28.840193 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b022-efef-4521-8fcb-04bbfd93c86e None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:28.840454 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b022-efef-4521-8fcb-04bbfd93c86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:28.867389 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-aef6b022-efef-4521-8fcb-04bbfd93c86e None None] MFA Rules not processed for user `41c4b45279d84fcbbe060dbe341f5fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:52:28.869618 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-aef6b022-efef-4521-8fcb-04bbfd93c86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:52:28.890215 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 621/1228] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Aug 22 17:52:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:52:28.900982 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd0d4e-d0fa-4d68-bd06-958a35406dc1 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:52:28.915537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd0d4e-d0fa-4d68-bd06-958a35406dc1 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:52:28.920950 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70054f55-69dc-43c0-8ed0-4100613ff73e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:52:28.921779 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054f55-69dc-43c0-8ed0-4100613ff73e service nova] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:28.922222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054f55-69dc-43c0-8ed0-4100613ff73e service nova] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:28.922772 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054f55-69dc-43c0-8ed0-4100613ff73e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:28.934821 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70054f55-69dc-43c0-8ed0-4100613ff73e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:52:28.936915 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70054f55-69dc-43c0-8ed0-4100613ff73e service nova] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:52:28.954224 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 608/1229] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:52:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:52:38.860246 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=9 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:38.945020 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=6 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:41.363448 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de12c-5214-44c3-afb1-f62a123e433b None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:52:41.364211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de12c-5214-44c3-afb1-f62a123e433b None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:52:41.364427 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de12c-5214-44c3-afb1-f62a123e433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:52:41.392972 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-060de12c-5214-44c3-afb1-f62a123e433b None None] MFA Rules not processed for user `07ba1cf9e543423b85474abf85b406a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:52:41.394165 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-060de12c-5214-44c3-afb1-f62a123e433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:52:41.401357 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 622/1230] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:52:41 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:52:51.386878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:53:07.756958 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24e75-c995-4b32-9709-80425aec40bf None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:53:07.757437 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24e75-c995-4b32-9709-80425aec40bf None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:53:07.757579 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24e75-c995-4b32-9709-80425aec40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:53:07.776643 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-06d24e75-c995-4b32-9709-80425aec40bf None None] MFA Rules not processed for user `07ba1cf9e543423b85474abf85b406a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:53:07.777951 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-06d24e75-c995-4b32-9709-80425aec40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:53:07.785639 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 609/1231] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:53:07 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:53:17.771840 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:53:22.499825 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c2984-5460-47f1-8708-e22c20180bbd None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:53:22.500325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c2984-5460-47f1-8708-e22c20180bbd None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:53:22.500325 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c2984-5460-47f1-8708-e22c20180bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:53:22.520546 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-8f4c2984-5460-47f1-8708-e22c20180bbd None None] MFA Rules not processed for user `07ba1cf9e543423b85474abf85b406a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:53:22.521756 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-8f4c2984-5460-47f1-8708-e22c20180bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:53:22.530931 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 623/1232] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:53:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:53:32.515392 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:54:24.182911 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71876e-bb99-4866-b60f-2dd1f1ffec78 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:54:24.183551 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71876e-bb99-4866-b60f-2dd1f1ffec78 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:54:24.183551 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71876e-bb99-4866-b60f-2dd1f1ffec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:54:24.205831 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-9f71876e-bb99-4866-b60f-2dd1f1ffec78 None None] MFA Rules not processed for user `07ba1cf9e543423b85474abf85b406a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:54:24.206966 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-9f71876e-bb99-4866-b60f-2dd1f1ffec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:54:24.215139 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 610/1233] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:54:24 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:54:34.199707 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:54:36.055868 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c2984-5460-47f1-8708-e22c20180bbd None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:54:36.079468 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c2984-5460-47f1-8708-e22c20180bbd None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:54:36.083998 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:54:36.084624 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:54:36.084929 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:54:36.085218 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:54:36.095051 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:54:36.096506 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:54:36.106391 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 624/1234] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:54:36 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:54:46.101912 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=10 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:55:40.920334 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71876e-bb99-4866-b60f-2dd1f1ffec78 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:55:40.942548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71876e-bb99-4866-b60f-2dd1f1ffec78 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:55:40.947937 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec31dea-45f6-44f0-bb6c-3072299ff603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd40f73d7b494ef1ba7e17bdb202ccee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:55:40.948537 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec31dea-45f6-44f0-bb6c-3072299ff603 service placement] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:55:40.948842 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec31dea-45f6-44f0-bb6c-3072299ff603 service placement] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:55:40.949112 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec31dea-45f6-44f0-bb6c-3072299ff603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:55:40.957760 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec31dea-45f6-44f0-bb6c-3072299ff603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:55:40.959343 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec31dea-45f6-44f0-bb6c-3072299ff603 service placement] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:55:40.969025 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 611/1235] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:55:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:55:50.965205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=10 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:56:43.292317 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:56:43.314686 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449af73-3423-4e16-8e75-87251bfa2367 service neutron] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:56:43.320894 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca70cc8-ebfd-47b4-9967-7138879cfd99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:56:43.321492 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca70cc8-ebfd-47b4-9967-7138879cfd99 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:56:43.321748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca70cc8-ebfd-47b4-9967-7138879cfd99 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:56:43.322030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca70cc8-ebfd-47b4-9967-7138879cfd99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:56:43.330569 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca70cc8-ebfd-47b4-9967-7138879cfd99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:56:43.332350 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca70cc8-ebfd-47b4-9967-7138879cfd99 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:56:43.342755 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 625/1236] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:56:43 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:56:47.074618 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423ed4-67be-4f67-b2e9-915703eec0db None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:56:47.075156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423ed4-67be-4f67-b2e9-915703eec0db None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:56:47.075156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423ed4-67be-4f67-b2e9-915703eec0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:56:47.095777 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-71423ed4-67be-4f67-b2e9-915703eec0db None None] MFA Rules not processed for user `07ba1cf9e543423b85474abf85b406a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:56:47.097161 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-71423ed4-67be-4f67-b2e9-915703eec0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:56:47.106275 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 612/1237] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:56:47 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:56:47.442898 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7877-e4ef-4e0b-89bc-2b247db21b44 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:56:47.443399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7877-e4ef-4e0b-89bc-2b247db21b44 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:56:47.443399 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7877-e4ef-4e0b-89bc-2b247db21b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:56:47.497907 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-c10e7877-e4ef-4e0b-89bc-2b247db21b44 None None] MFA Rules not processed for user `17d25b471b4a4c78bea1456094b584c4`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:56:47.499123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-c10e7877-e4ef-4e0b-89bc-2b247db21b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:56:47.508069 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 626/1238] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Aug 22 17:56:47 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:56:47.525598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71423ed4-67be-4f67-b2e9-915703eec0db None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:56:47.537042 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71423ed4-67be-4f67-b2e9-915703eec0db None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:56:47.541405 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:56:47.542005 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:56:47.542282 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:56:47.542548 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:56:47.550009 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:56:47.551441 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:56:47.559359 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 613/1239] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:56:47 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:56:50.302266 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7877-e4ef-4e0b-89bc-2b247db21b44 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:56:50.312573 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7877-e4ef-4e0b-89bc-2b247db21b44 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:56:50.317275 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:56:50.317953 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:56:50.318263 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:56:50.318580 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:56:50.330981 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:56:50.332462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:56:50.343748 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 627/1240] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:56:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:56:53.913407 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:56:53.922325 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d081e1-b434-465d-ac04-0508d86ecdf5 service neutron] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:56:53.927266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:56:53.927862 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:56:53.928155 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:56:53.928402 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:56:53.938454 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:56:53.939886 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:56:53.950013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 614/1241] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:56:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:00.338855 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=29 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:57:03.938712 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:03.945541 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=15 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:57:03.951265 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e9b90-d471-4f8d-9dbe-35f4c80a858b service neutron] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:03.957792 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:03.958412 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:03.958680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:03.958947 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:03.968355 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:03.970093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:03.980313 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 628/1242] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:03 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:05.233108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:05.242149 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9454a3-e1dd-4cb3-b235-62097db674d1 service neutron] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:05.246152 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff890b-5405-4b5e-85b3-590c359f5091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:05.246917 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff890b-5405-4b5e-85b3-590c359f5091 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:05.247192 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff890b-5405-4b5e-85b3-590c359f5091 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:05.247460 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff890b-5405-4b5e-85b3-590c359f5091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:05.254718 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff890b-5405-4b5e-85b3-590c359f5091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:05.256436 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff890b-5405-4b5e-85b3-590c359f5091 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:05.264964 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 615/1243] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:05 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:10.656551 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:10.667719 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545f91-a807-4d8e-bd4c-ca3ce6f0915a service nova] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:10.672992 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:10.673603 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:10.673877 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:10.674145 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:10.683466 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:10.685053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:10.696534 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 629/1244] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:10 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:15.261108 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=6 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:57:19.670710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d770d-b8f9-4041-8c1c-30683afdfed5 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:19.671361 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d770d-b8f9-4041-8c1c-30683afdfed5 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:19.671484 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d770d-b8f9-4041-8c1c-30683afdfed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:19.693424 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-844d770d-b8f9-4041-8c1c-30683afdfed5 None None] MFA Rules not processed for user `fc67644b403243cb9fd489d1e01fd402`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:57:19.694853 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-844d770d-b8f9-4041-8c1c-30683afdfed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:57:19.704353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 616/1245] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:57:19 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:57:19.993077 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:20.003889 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f99c27-b96d-4e99-92d2-98dd1dde3dba service nova] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:20.009093 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:20.009862 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:20.010287 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:20.010740 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:20.019687 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:20.021701 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:20.030396 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 630/1246] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:19 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:20.369266 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d770d-b8f9-4041-8c1c-30683afdfed5 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:20.381907 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d770d-b8f9-4041-8c1c-30683afdfed5 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:20.387455 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd40f73d7b494ef1ba7e17bdb202ccee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:20.388098 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:20.388372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:20.388663 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:20.398786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:20.400388 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:20.410918 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 617/1247] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:30.026665 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=18 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:57:30.406345 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=9 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:57:36.683504 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:36.697935 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098902f-ae8d-45b6-9010-fa4e58c18fdf service neutron] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:36.704235 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:36.704983 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:36.705252 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:36.705537 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:36.714680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:36.716326 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:36.726437 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 631/1248] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:45.453270 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:45.463789 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aaf07-d812-4015-a4f9-e89fa97796bf service placement] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:45.468160 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56f39c-ef31-4737-a7ac-675a9c6ce721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:45.469223 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f39c-ef31-4737-a7ac-675a9c6ce721 service neutron] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:45.469496 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f39c-ef31-4737-a7ac-675a9c6ce721 service neutron] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:45.469759 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f39c-ef31-4737-a7ac-675a9c6ce721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:45.480186 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56f39c-ef31-4737-a7ac-675a9c6ce721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:45.481598 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56f39c-ef31-4737-a7ac-675a9c6ce721 service neutron] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:45.491322 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 618/1249] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:45 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:46.723178 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=6 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:57:47.259952 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:57:47.271971 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d41c65-d30a-4d19-aa45-980e3e2408d3 service nova] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:57:47.279796 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41c4b45279d84fcbbe060dbe341f5fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:57:47.280528 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:57:47.280899 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:57:47.281362 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:57:47.291422 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:57:47.293168 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:57:47.304285 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 632/1250] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 17:57:47 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:57:55.487007 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=6 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:57:57.299655 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=6 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:58:58.408129 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47017c-9932-47ab-b6a5-dd0a084471f4 None None] REQUEST_METHOD: `POST` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:58:58.408700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47017c-9932-47ab-b6a5-dd0a084471f4 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:58:58.408700 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47017c-9932-47ab-b6a5-dd0a084471f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:58:58.439369 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.auth.core [None req-ce47017c-9932-47ab-b6a5-dd0a084471f4 None None] MFA Rules not processed for user `07ba1cf9e543423b85474abf85b406a3`. Rule list: `[]` (Enabled: `True`). {{(pid=100234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:58:58.441193 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-ce47017c-9932-47ab-b6a5-dd0a084471f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:58:58.449947 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 619/1251] 10.222.0.59 () {58 vars in 958 bytes} [Mon Aug 22 17:58:58 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:59:08.428901 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=3 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:00:14.540817 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:00:14.542773 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:00:14.588726 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaf4e1-959e-4170-9274-d170eb97c87b service nova] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:00:14.592462 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de640d1-cc02-4ced-be87-a331fd69e3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:00:14.593102 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de640d1-cc02-4ced-be87-a331fd69e3eb service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:14.593375 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de640d1-cc02-4ced-be87-a331fd69e3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:14.593637 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de640d1-cc02-4ced-be87-a331fd69e3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:14.686429 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de640d1-cc02-4ced-be87-a331fd69e3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:00:14.687882 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de640d1-cc02-4ced-be87-a331fd69e3eb service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:00:14.708134 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 633/1252] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 18:00:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 18:00:18.528441 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749b27d-2c1c-45cc-b7ec-616ec9affaf7 None None] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:18.529064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749b27d-2c1c-45cc-b7ec-616ec9affaf7 None None] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:18.529064 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749b27d-2c1c-45cc-b7ec-616ec9affaf7 None None] PATH_INFO: `/` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:18.530710 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 620/1253] 10.222.0.59 () {54 vars in 921 bytes} [Mon Aug 22 18:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 18:00:18.542903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ea28-cd1c-405c-901f-5fbb7b2303d1 None None] REQUEST_METHOD: `POST` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:18.543493 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ea28-cd1c-405c-901f-5fbb7b2303d1 None None] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:18.543587 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ea28-cd1c-405c-901f-5fbb7b2303d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:18.618032 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.auth.core [None req-4c97ea28-cd1c-405c-901f-5fbb7b2303d1 None None] MFA Rules not processed for user `cd40f73d7b494ef1ba7e17bdb202ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=100233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 18:00:18.619470 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-4c97ea28-cd1c-405c-901f-5fbb7b2303d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:00:18.630415 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 634/1254] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Aug 22 18:00:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 18:00:18.643751 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749b27d-2c1c-45cc-b7ec-616ec9affaf7 None None] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:00:18.659638 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749b27d-2c1c-45cc-b7ec-616ec9affaf7 None None] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:00:18.665457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd40f73d7b494ef1ba7e17bdb202ccee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:00:18.666206 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:18.666661 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:18.667024 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:18.677359 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:00:18.679099 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:00:18.691592 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 621/1255] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 18:00:18 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 18:00:22.163762 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ea28-cd1c-405c-901f-5fbb7b2303d1 None None] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:00:22.177126 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ea28-cd1c-405c-901f-5fbb7b2303d1 None None] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:00:22.182053 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:00:22.182692 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:22.183157 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:22.183428 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] PATH_INFO: `/v3/users/fc67644b403243cb9fd489d1e01fd402` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:22.184544 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc67644b403243cb9fd489d1e01fd402)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:00:22.186618 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:00:22.238923 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:00:22.241732 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc67644b403243cb9fd489d1e01fd402'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.242831 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc67644b403243cb9fd489d1e01fd402'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.252323 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc67644b403243cb9fd489d1e01fd402'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.264179 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc67644b403243cb9fd489d1e01fd402'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.271779 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc67644b403243cb9fd489d1e01fd402'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.277858 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 635/1256] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Aug 22 18:00:22 2022] DELETE /identity/v3/users/fc67644b403243cb9fd489d1e01fd402 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:00:22.459372 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:00:22.470786 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730c86e-93e5-46bc-b805-11e2dc34a76b service placement] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:00:22.542373 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:00:22.543017 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:22.543288 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:22.543557 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] PATH_INFO: `/v3/projects/c02ba3273e5a4a50a780781ec2dd0066` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:22.544885 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02ba3273e5a4a50a780781ec2dd0066)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:00:22.546795 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:00:22.597156 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02ba3273e5a4a50a780781ec2dd0066', 'request_id': 'req-e0c909e9-9388-4862-ab44-cc9f38639f3b'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.603898 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02ba3273e5a4a50a780781ec2dd0066', 'request_id': 'req-e0c909e9-9388-4862-ab44-cc9f38639f3b'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.615084 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02ba3273e5a4a50a780781ec2dd0066', 'request_id': 'req-e0c909e9-9388-4862-ab44-cc9f38639f3b'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.642646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] The token cache is being invalidate because project c02ba3273e5a4a50a780781ec2dd0066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 18:00:22.642928 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.643686 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.646010 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 622/1257] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Aug 22 18:00:22 2022] DELETE /identity/v3/projects/c02ba3273e5a4a50a780781ec2dd0066 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:00:22.650424 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:00:22.651884 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:00:22.665545 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84dd69-09ff-4dbd-b2dc-6499fda8a6a7 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:00:22.729708 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:00:22.730361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:22.730636 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:22.730903 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] PATH_INFO: `/v3/users/26fa70b8e4034f778ca2a89b2d779bd2` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:22.732055 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fa70b8e4034f778ca2a89b2d779bd2)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:00:22.734064 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:00:22.784229 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fa70b8e4034f778ca2a89b2d779bd2'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.784994 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fa70b8e4034f778ca2a89b2d779bd2'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.794371 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fa70b8e4034f778ca2a89b2d779bd2'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.807557 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fa70b8e4034f778ca2a89b2d779bd2'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.814918 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fa70b8e4034f778ca2a89b2d779bd2'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:22.821213 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 636/1258] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Aug 22 18:00:22 2022] DELETE /identity/v3/users/26fa70b8e4034f778ca2a89b2d779bd2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:00:23.001814 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:00:23.003353 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:00:23.016655 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c909e9-9388-4862-ab44-cc9f38639f3b admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:00:23.076013 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:00:23.076671 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:23.076946 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:23.077210 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] PATH_INFO: `/v3/projects/d086ea42bb18430e9cf6fded08b5c14f` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:23.078306 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d086ea42bb18430e9cf6fded08b5c14f)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:00:23.080213 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:00:23.088171 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:00:23.128561 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd086ea42bb18430e9cf6fded08b5c14f', 'request_id': 'req-5d1a2792-0f99-4b61-977b-29a125e38f10'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:23.134606 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd086ea42bb18430e9cf6fded08b5c14f', 'request_id': 'req-5d1a2792-0f99-4b61-977b-29a125e38f10'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:23.143075 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd086ea42bb18430e9cf6fded08b5c14f', 'request_id': 'req-5d1a2792-0f99-4b61-977b-29a125e38f10'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:23.153117 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] The token cache is being invalidate because project d086ea42bb18430e9cf6fded08b5c14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 18:00:23.153398 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:23.154041 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:00:23.155560 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 623/1259] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Aug 22 18:00:23 2022] DELETE /identity/v3/projects/d086ea42bb18430e9cf6fded08b5c14f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:00:32.817649 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:00:33.150399 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:00:47.552677 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:00:47.555238 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:00:47.641410 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7264c1-6028-46bd-860e-5df8680f4280 admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:00:47.701518 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd40f73d7b494ef1ba7e17bdb202ccee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:00:47.702123 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:00:47.702397 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:00:47.702658 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:00:47.704745 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:00:47.715944 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:00:47.717532 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:00:47.727235 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 637/1260] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 18:00:47 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 18:00:57.723529 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=58 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:01:43.400196 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:01:43.402046 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:01:43.501145 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2792-0f99-4b61-977b-29a125e38f10 admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:01:43.505836 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c432d2d2ec4be6b34839a86ce15036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:01:43.506457 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:01:43.506725 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:01:43.506991 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:01:43.509041 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:01:43.602062 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:01:43.603543 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:01:43.622851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 624/1261] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 18:01:43 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 18:01:44.952380 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:01:44.953902 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:01:45.025049 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858974-f3a2-4bdc-b7c8-cdb060a16550 service placement] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:01:45.029523 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d25b471b4a4c78bea1456094b584c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:01:45.030130 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] REQUEST_METHOD: `GET` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:01:45.030407 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:01:45.030674 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:01:45.032804 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:01:45.097361 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:01:45.099222 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:01:45.109371 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 638/1262] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 18:01:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 18:01:51.673263 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:01:51.675258 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:01:51.690477 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9e520-6119-442e-84bf-25ea3c174dd5 service cinder] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:01:51.695303 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:01:51.695934 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:01:51.696205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:01:51.696469 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] PATH_INFO: `/v3/users/07ba1cf9e543423b85474abf85b406a3` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:01:51.697617 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ba1cf9e543423b85474abf85b406a3)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:01:51.698621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: WARNING py.warnings [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 18:01:51.698621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: warnings.warn(msg) Aug 22 18:01:51.698621 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: Aug 22 18:01:51.699823 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:01:51.767712 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ba1cf9e543423b85474abf85b406a3'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:51.778120 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ba1cf9e543423b85474abf85b406a3'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:51.778799 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ba1cf9e543423b85474abf85b406a3'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:51.779489 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ba1cf9e543423b85474abf85b406a3'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:51.783200 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:01:51.790222 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ba1cf9e543423b85474abf85b406a3'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:51.818563 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 625/1263] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Aug 22 18:01:51 2022] DELETE /identity/v3/users/07ba1cf9e543423b85474abf85b406a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:01:52.008094 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:01:52.020082 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2dbdf-6d2a-4750-901a-2a68d2046185 service neutron] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:01:52.083871 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:01:52.084428 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] REQUEST_METHOD: `DELETE` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:01:52.084754 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:01:52.085020 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] PATH_INFO: `/v3/projects/9f2d1cfeaa0f4c27b102b3b6478212d0` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:01:52.086195 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2d1cfeaa0f4c27b102b3b6478212d0)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:01:52.087211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: WARNING py.warnings [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 18:01:52.087211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: warnings.warn(msg) Aug 22 18:01:52.087211 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: Aug 22 18:01:52.088444 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:01:52.137694 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:01:52.148643 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2d1cfeaa0f4c27b102b3b6478212d0', 'request_id': 'req-a5327486-8d81-431f-bc82-8078148a617c'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.162277 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2d1cfeaa0f4c27b102b3b6478212d0', 'request_id': 'req-a5327486-8d81-431f-bc82-8078148a617c'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.169075 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2d1cfeaa0f4c27b102b3b6478212d0', 'request_id': 'req-a5327486-8d81-431f-bc82-8078148a617c'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.184680 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] The token cache is being invalidate because project 9f2d1cfeaa0f4c27b102b3b6478212d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 18:01:52.184966 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.185575 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.187072 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 639/1264] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Aug 22 18:01:52 2022] DELETE /identity/v3/projects/9f2d1cfeaa0f4c27b102b3b6478212d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:01:52.191205 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:01:52.193050 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:01:52.206696 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a8c13-c71b-4239-b07e-af54387a6c0b admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:01:52.270644 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:01:52.271335 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:01:52.271595 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:01:52.271864 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] PATH_INFO: `/v3/users/34a37335fab04d53998fd5d40d2f4fb2` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:01:52.286675 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a37335fab04d53998fd5d40d2f4fb2)` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:01:52.288646 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:01:52.342360 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a37335fab04d53998fd5d40d2f4fb2'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.349189 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a37335fab04d53998fd5d40d2f4fb2'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.349851 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a37335fab04d53998fd5d40d2f4fb2'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.350464 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a37335fab04d53998fd5d40d2f4fb2'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.358934 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.notifications [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a37335fab04d53998fd5d40d2f4fb2'} {{(pid=100234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.375819 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 626/1265] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Aug 22 18:01:52 2022] DELETE /identity/v3/users/34a37335fab04d53998fd5d40d2f4fb2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:01:52.557975 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Authenticating user token {{(pid=100233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:01:52.559072 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.fernet_utils [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:01:52.572950 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5327486-8d81-431f-bc82-8078148a617c admin admin] Validating token access rules against request {{(pid=100233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:01:52.633278 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b314b21b589848739470473da31c8430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a065a84a79f4e27982ec8e2b3054801', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:01:52.633808 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:01:52.634083 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:01:52.634353 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] PATH_INFO: `/v3/projects/4980c13955564febaebe4e1985cc9b23` {{(pid=100233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:01:52.646030 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4980c13955564febaebe4e1985cc9b23)` {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:01:52.648943 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] RBAC: Authorization granted {{(pid=100233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:01:52.701463 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4980c13955564febaebe4e1985cc9b23', 'request_id': 'req-bf735562-9303-4df0-ba09-447283f9b941'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.710214 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4980c13955564febaebe4e1985cc9b23', 'request_id': 'req-bf735562-9303-4df0-ba09-447283f9b941'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.716377 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4980c13955564febaebe4e1985cc9b23', 'request_id': 'req-bf735562-9303-4df0-ba09-447283f9b941'} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.730878 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] The token cache is being invalidate because project 4980c13955564febaebe4e1985cc9b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=100233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 18:01:52.731159 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.731781 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG keystone.notifications [None req-bf735562-9303-4df0-ba09-447283f9b941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=100233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 18:01:52.733331 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: [pid: 100233|app: 0|req: 640/1266] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Aug 22 18:01:52 2022] DELETE /identity/v3/projects/4980c13955564febaebe4e1985cc9b23 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 18:02:02.372790 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=66,keystone:DELETE=12,keystone:INSERT=1 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:02:02.727835 dv-osbrick-853787-1-ceph devstack@keystone.service[100233]: DEBUG dbcounter [-] [100233] Writing DB stats keystone:SELECT=64,keystone:DELETE=11,keystone:INSERT=2 {{(pid=100233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 18:05:52.842174 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Authenticating user token {{(pid=100234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 18:05:52.843893 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:05:52.927923 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf234fd5-e86f-47fc-90a6-a1596ff0aa40 admin admin] Validating token access rules against request {{(pid=100234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 18:05:52.996131 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf55b22-c59d-4cce-be33-eca417f0dec7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd40f73d7b494ef1ba7e17bdb202ccee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb47a6c68ef54e3d97e6df4288eaf596', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 18:05:52.996818 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55b22-c59d-4cce-be33-eca417f0dec7 service placement] REQUEST_METHOD: `GET` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 18:05:52.997072 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55b22-c59d-4cce-be33-eca417f0dec7 service placement] SCRIPT_NAME: `/identity` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 18:05:52.997365 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55b22-c59d-4cce-be33-eca417f0dec7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=100234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 18:05:52.999392 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.fernet_utils [None req-fcf55b22-c59d-4cce-be33-eca417f0dec7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=100234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 18:05:53.011769 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf55b22-c59d-4cce-be33-eca417f0dec7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 18:05:53.013427 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf55b22-c59d-4cce-be33-eca417f0dec7 service placement] RBAC: Authorization granted {{(pid=100234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 18:05:53.023699 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: [pid: 100234|app: 0|req: 627/1267] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Aug 22 18:05:52 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 18:06:03.019237 dv-osbrick-853787-1-ceph devstack@keystone.service[100234]: DEBUG dbcounter [-] [100234] Writing DB stats keystone:SELECT=62 {{(pid=100234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}